Jul 21 18:59:13 devstack cinder-volume[76549]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 18:59:13 devstack cinder-volume[76549]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 18:59:13 devstack cinder-volume[76549]: we strongly recommend against using it for new projects. Jul 21 18:59:13 devstack cinder-volume[76549]: If you are already using Eventlet, we recommend migrating to a different Jul 21 18:59:13 devstack cinder-volume[76549]: framework. For more detail see Jul 21 18:59:13 devstack cinder-volume[76549]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 18:59:13 devstack cinder-volume[76549]: import eventlet # noqa Jul 21 18:59:16 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 18:59:16 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 18:59:16 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 18:59:16 devstack cinder-volume[76549]: INFO dbcounter [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Registered counter for database cinder Jul 21 18:59:16 devstack cinder-volume[76549]: DEBUG oslo_db.sqlalchemy.engines [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG dbcounter [-] [76549] Writer thread running {{(pid=76549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:59:17 devstack cinder-volume[76549]: INFO cinder.rpc [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 18:59:17 devstack cinder-volume[76549]: INFO cinder.rpc [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG oslo_db.sqlalchemy.engines [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:59:17 devstack cinder-volume[76549]: INFO cinder.volume.manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Determined volume DB was empty at startup. Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG cinder.volume.manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76549) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 18:59:17 devstack cinder-volume[76549]: INFO cinder.volume.manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 18:59:17 devstack cinder-volume[76549]: WARNING stevedore.named [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:59:17 devstack cinder-volume[76549]: WARNING castellan.key_manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:59:17 devstack cinder-volume[76549]: WARNING cinder.keymgr.conf_key_mgr [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG cinder.volume.drivers.lvm [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76549) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG oslo_concurrency.processutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:17 devstack cinder-volume[76549]: DEBUG oslo_concurrency.processutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] CMD "cinder-rtstool verify" returned: 0 in 0.483s {{(pid=76549) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_db.sqlalchemy.engines [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:59:18 devstack cinder-volume[76549]: INFO cinder.rpc [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 18:59:18 devstack cinder-volume[76549]: INFO cinder.rpc [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 18:59:18 devstack cinder-volume[76549]: WARNING stevedore.named [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 18:59:18 devstack cinder-volume[76549]: WARNING castellan.key_manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 18:59:18 devstack cinder-volume[76549]: INFO cinder.volume.manager [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_db.sqlalchemy.engines [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76549) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:59:18 devstack cinder-volume[76549]: INFO oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Starting 1 workers Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Started child 76684 {{(pid=76549) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Full set of CONF: {{(pid=76549) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] ******************************************************************************** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Configuration options gathered from: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] ================================================================================ {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 18:59:18 devstack cinder-volume[76684]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] allow_availability_zone_fallback = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] allow_compression_on_image_upload = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] allowed_direct_url_schemes = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] api_rate_limit = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] auth_strategy = keystone {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] az_cache_duration = 3600 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_availability_zone = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_host = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_stats_polling_interval = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backup_api_class = cinder.backup.api.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backup_name_template = backup-%s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backup_use_same_host = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backup_use_temp_snapshot = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] chap_password = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] chap_username = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_internal_tenant_project_id = 63bf582b072c48c8a18015de3c5daf9d {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_internal_tenant_user_id = c992beec879f4052b7f72efd81e78458 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cloned_volume_same_az = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cluster = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] compression_format = gzip {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] compute_api_class = cinder.compute.nova.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] config_dir = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] config_source = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] control_exchange = openstack {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] debug = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] default_availability_zone = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] default_group_type = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] default_volume_type = lvmdriver-1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] disk_geometry = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_client_cert = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_client_cert_key = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_data_namespace = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_ssl_cert_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_ssl_cert_verify = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] driver_use_ssl = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] enable_force_upload = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] enable_new_services = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] enable_unsupported_driver = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] enforce_multipath_for_image_xfer = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] filter_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_api_insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_api_ssl_compression = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_ca_certificates_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_catalog_info = image:glance:publicURL {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: INFO cinder.volume.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_num_retries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance_request_timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] goodness_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] graceful_shutdown_timeout = 5 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] group_api_class = cinder.group.api.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] host = devstack {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_compress_on_upload = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_conversion_address_space_limit = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_conversion_cpu_limit = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_conversion_disable = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_upload_use_cinder_backend = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_upload_use_internal_tenant = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_volume_cache_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_volume_cache_max_count = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] image_volume_cache_max_size_gb = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] init_host_max_objects_retrieval = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] instance_format = [instance: %(uuid)s] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iscsi_target_flags = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iscsi_write_cache = on {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iser_helper = tgtadm {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iser_ip_address = 192.168.122.177 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iser_port = 3260 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_color = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_config_append = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_dir = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_options = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_rotate_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_rotate_interval_type = days {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] log_rotation_type = none {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] max_age = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] max_logfile_count = 30 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] max_logfile_size_mb = 200 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] max_over_subscription_ratio = 20.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] message_reap_interval = 86400 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] message_ttl = 2592000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] migration_create_volume_timeout_secs = 300 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] monkey_patch = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] monkey_patch_modules = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] my_ip = 192.168.122.177 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] no_snapshot_gb_quota = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] num_iser_scan_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] num_shell_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] num_volume_device_scan_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] nvmeof_conn_info_version = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] nvmet_ns_id = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] nvmet_port_id = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_max_limit = 1000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_ext_list = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_listen_port = 8776 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_use_ssl = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] osapi_volume_workers = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] per_volume_size_limit = -1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] periodic_fuzzy_delay = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] periodic_interval = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] public_endpoint = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] publish_errors = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_backup_gigabytes = 1000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_backups = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_gigabytes = 1000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_groups = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_snapshots = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] quota_volumes = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] rate_limit_burst = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] rate_limit_except_level = CRITICAL {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] rate_limit_interval = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] reinit_driver_count = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] replication_device = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] report_discard_supported = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] report_interval = 120 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] reservation_clean_interval = 86400 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] reservation_expire = 86400 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] reserved_image_namespaces = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] reserved_percentage = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] rpc_response_timeout = 120 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] run_external_periodic_tasks = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] scst_target_driver = iscsi {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] scst_target_iqn_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_down_time = 720 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] shell_completion = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] snapshot_name_template = snapshot-%s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] snapshot_same_host = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] split_loggers = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] state_path = /opt/stack/data/cinder {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] storage_availability_zone = nova {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] storage_protocol = iSCSI {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] syslog_log_facility = LOG_USER {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_helper = lioadm {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_ip_address = 192.168.122.177 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_port = 3260 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_protocol = iscsi {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] target_secondary_ip_addresses = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] trace_flags = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] transport_url = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] until_refresh = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_chap_auth = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_default_quota_class = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_journal = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_json = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_multipath_for_image_xfer = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_stderr = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] use_syslog = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] verify_glance_signatures = enabled {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_api_class = cinder.volume.api.API {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_backend_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_clear = zero {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_clear_ionice = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_clear_size = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_copy_bps_limit = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_dd_blocksize = 1M {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_name_template = volume-%s {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_service_inithost_offload = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volume_usage_audit_period = month {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] zoning_mode = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_concurrency.disable_process_locking = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.auth_section = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.auth_type = password {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.auth_version = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.cache = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.include_service_catalog = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.interface = public {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_password = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcache_username = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.region_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.service_type = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.backend = dogpile.cache.null {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.backend_argument = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.backend_expiration_time = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.config_prefix = cache.oslo {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.debug_cache_backend = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.enable_retry_client = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.enable_socket_keepalive = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.expiration_time = 600 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.hashclient_retry_attempts = 2 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_dead_retry = 300 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_pool_maxsize = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_sasl_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.password = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.proxies = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.redis_db = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.redis_server = localhost:6379 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.retry_attempts = 2 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.retry_delay = 0.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.socket_keepalive_count = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.socket_keepalive_idle = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.socket_keepalive_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.socket_timeout = 1.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.tls_allowed_ciphers = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.tls_cafile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.tls_certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.tls_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.tls_keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cache.username = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] coordination.backend_url = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.asyncio_connection = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.asyncio_slave_connection = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.backend = sqlalchemy {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.connection = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.connection_debug = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.connection_parameters = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.connection_recycle_time = 3600 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.connection_trace = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.db_inc_retry_interval = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.db_max_retries = 20 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.db_max_retry_interval = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.db_retry_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.max_overflow = 50 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.max_pool_size = 5 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.max_retries = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack sudo[76688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.mysql_wsrep_sync_wait = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.pool_timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.retry_interval = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.slave_connection = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.sqlite_synchronous = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.synchronous_reader = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] database.use_db_reconnect = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack sudo[76688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.connection_string = messaging:// {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.es_doc_type = notification {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.es_scroll_size = 10000 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.es_scroll_time = 2m {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.filter_error_trace = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.hmac_keys = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.sentinel_service_name = mymaster {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.socket_timeout = 0.1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.trace_requests = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler.trace_sqlalchemy = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler_jaeger.process_tags = {} {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler_jaeger.service_name_prefix = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] profiler_otlp.service_name_prefix = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.enforce_new_defaults = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.policy_default_rule = default {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.policy_file = policy.yaml {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.group = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.helper_command = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] privsep_osbrick.user = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.group = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.helper_command = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] cinder_sys_admin.user = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.auth_section = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.auth_type = password {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.cafile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.collect_timing = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.send_service_user_token = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.split_loggers = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] service_user.timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.auth_section = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.auth_type = password {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.collect_timing = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.region_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.split_loggers = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] glance.timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.backend_availability_zone = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.chap_password = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.chap_username = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.disk_geometry = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_client_cert = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_client_cert_key = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_data_namespace = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.driver_use_ssl = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.extra_capabilities = {} {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.filter_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.goodness_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iscsi_target_flags = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iscsi_write_cache = on {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iser_helper = tgtadm {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iser_port = 3260 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.lvm_share_target = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.lvm_type = auto {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.num_shell_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.replication_device = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.report_discard_supported = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.reserved_percentage = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_helper = tgtadm {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_port = 3260 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_protocol = iscsi {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.trace_flags = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.unique_fqdn_network = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.use_chap_auth = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_backend_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_clear = zero {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_clear_ionice = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_clear_size = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_reports.file_event_handler = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_reports.log_dir = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.backend_host = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.chap_password = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.chap_username = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.disk_geometry = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_client_cert = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.extra_capabilities = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.filter_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.goodness_function = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iser_helper = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iser_ip_address = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iser_port = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.lvm_share_target = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.lvm_type = auto {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.num_shell_tries = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.replication_device = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.report_discard_supported = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.reserved_percentage = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.scst_target_driver = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.storage_protocol = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_helper = lioadm {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_ip_address = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_port = 3260 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.trace_flags = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.use_chap_auth = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_clear = zero {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_clear_size = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] lvmdriver-1.volumes_dir = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_notifications.driver = [] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_notifications.retry = -1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] key_manager.fixed_key = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.barbican_api_version = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.barbican_endpoint = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.barbican_endpoint_type = public {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.barbican_region_name = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.cafile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.collect_timing = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.number_of_retries = 60 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.retry_delay = 1 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.send_service_user_token = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.split_loggers = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.verify_ssl = True {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican.verify_ssl_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.auth_section = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.auth_type = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.cafile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.certfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.collect_timing = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.insecure = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.keyfile = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.split_loggers = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] barbican_service_user.timeout = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.approle_role_id = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.approle_secret_id = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.auth_method = approle {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.auth_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.kv_mountpoint = secret {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.kv_path = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.kv_version = 2 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.namespace = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.root_token_id = **** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.ssl_ca_crt_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.timeout = 60.0 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.token_file = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.token_role = None {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.use_ssl = False {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 18:59:18 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] ******************************************************************************** {{(pid=76549) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 18:59:18 devstack sudo[76688]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:18 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:18 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.286s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 18:59:18 devstack cinder-volume[76684]: INFO cinder.brick.local_dev.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:18 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:18 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:18 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:19 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG cinder.brick.local_dev.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76684) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:19 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:19 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:19 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:19 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:19 devstack sudo[77267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:19 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:20 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:20 devstack sudo[77329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 18:59:20 devstack sudo[77329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:20 devstack sudo[77329]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:20 devstack sudo[77374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:20 devstack sudo[77374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:20 devstack sudo[77374]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:20 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:20 devstack sudo[77415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:20 devstack sudo[77415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:21 devstack sudo[77415]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack sudo[77424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:21 devstack sudo[77424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:21 devstack sudo[77424]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack sudo[77498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:21 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:21 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack sudo[77511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:21 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:21 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: INFO cinder.volume.drivers.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:21 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:21 devstack sudo[77516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:21 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:22 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:22 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:22 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:22 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:22 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:22 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:22 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:22 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:22 devstack sudo[77531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:22 devstack sudo[77531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:23 devstack sudo[77531]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:23 devstack sudo[77535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:23 devstack sudo[77535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:23 devstack sudo[77535]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:23 devstack cinder-volume[76684]: INFO cinder.volume.driver [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG cinder.volume.driver [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76684) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_db.sqlalchemy.engines [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76684) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG dbcounter [-] [76684] Writer thread running {{(pid=76684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG cinder.db.api [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Building query based on filter {{(pid=76684) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG cinder.image.image_utils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76684) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 18:59:23 devstack cinder-volume[76684]: INFO cinder.keymgr.migration [None req-8e7533af-84f8-4e86-810a-099ae1fa0c38 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:23 devstack sudo[77539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:23 devstack sudo[77539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:23 devstack sudo[77539]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:23 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:23 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:23 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:23 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:23 devstack sudo[77546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:23 devstack sudo[77546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:24 devstack sudo[77546]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:24 devstack sudo[77550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:24 devstack sudo[77550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:24 devstack sudo[77550]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG cinder.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Notifying Schedulers of capabilities ... {{(pid=76684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 18:59:24 devstack cinder-volume[76684]: INFO cinder.volume.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Driver initialization completed successfully. Jul 21 18:59:24 devstack cinder-volume[76684]: INFO cinder.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Initiating service 2 cleanup Jul 21 18:59:24 devstack cinder-volume[76684]: INFO cinder.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Service 2 cleanup completed. Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG cinder.service [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Creating RPC server for service cinder-volume {{(pid=76684) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG cinder.service [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76684) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 18:59:24 devstack cinder-volume[76684]: INFO cinder.volume.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:24 devstack sudo[77554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 18:59:24 devstack sudo[77554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:24 devstack sudo[77554]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:24 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:25 devstack sudo[77557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:25 devstack sudo[77557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:25 devstack sudo[77557]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:25 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:25 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:25 devstack sudo[77560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 18:59:25 devstack sudo[77560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:25 devstack sudo[77560]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:25 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:25 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 18:59:25 devstack sudo[77563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 18:59:25 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 18:59:25 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root Jul 21 18:59:25 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 18:59:25 devstack cinder-volume[76684]: INFO cinder.volume.manager [None req-23a901bd-077f-46ed-b628-7d10c0651a32 None None] Driver post RPC initialization completed successfully. Jul 21 18:59:28 devstack cinder-volume[76549]: DEBUG dbcounter [-] [76549] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76549) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:59:34 devstack cinder-volume[76684]: DEBUG dbcounter [-] [76684] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:59:35 devstack cinder-volume[76684]: DEBUG dbcounter [-] [76684] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 18:59:50 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager._thread_info {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 18:59:50 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread count: 6 {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 18:59:50 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread info: [<_MainThread(MainThread, started 125575948001408)>, , , , , ] {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:00:50 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:50 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 19:00:50 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:50 devstack sudo[80208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 19:00:50 devstack sudo[80208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:51 devstack sudo[80208]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:51 devstack sudo[80211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:00:51 devstack sudo[80211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:51 devstack sudo[80211]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:51 devstack sudo[80214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 19:00:51 devstack sudo[80214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:51 devstack sudo[80214]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:00:51 devstack sudo[80217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:00:51 devstack sudo[80217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:00:51 devstack sudo[80217]: pam_unix(sudo:session): session closed for user root Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG cinder.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Notifying Schedulers of capabilities ... {{(pid=76684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager._thread_info {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread count: 6 {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:00:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread info: [<_MainThread(MainThread, started 125575948001408)>, , , , , ] {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:01:35 devstack cinder-volume[76684]: DEBUG dbcounter [-] [76684] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:01:50 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:01:50 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 19:01:50 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:50 devstack sudo[83193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 19:01:50 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:51 devstack sudo[83196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:01:51 devstack sudo[83196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack sudo[83196]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:51 devstack sudo[83199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 19:01:51 devstack sudo[83199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack sudo[83199]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:01:51 devstack sudo[83202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:01:51 devstack sudo[83202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:01:51 devstack sudo[83202]: pam_unix(sudo:session): session closed for user root Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:01:51 devstack cinder-volume[76684]: DEBUG cinder.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Notifying Schedulers of capabilities ... {{(pid=76684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:50 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:02:50 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 19:02:50 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:50 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 19:02:50 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:51 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:51 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:02:51 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:51 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:51 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 19:02:51 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:51 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:02:51 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:02:51 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:02:51 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG cinder.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Notifying Schedulers of capabilities ... {{(pid=76684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager._thread_info {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread count: 6 {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:02:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread info: [<_MainThread(MainThread, started 125575948001408)>, , , , , ] {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:03:35 devstack cinder-volume[76684]: DEBUG dbcounter [-] [76684] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76684) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:03:50 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:50 devstack cinder-volume[76684]: DEBUG cinder.volume.drivers.lvm [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Updating volume stats {{(pid=76684) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 19:03:50 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:50 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 19:03:50 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:51 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:51 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:03:51 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:51 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:51 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 19:03:51 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:51 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:03:51 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 19:03:51 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:03:51 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_concurrency.processutils [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76684) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG cinder.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Notifying Schedulers of capabilities ... {{(pid=76684) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG oslo_service.periodic_task [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] Running periodic task VolumeManager._thread_info {{(pid=76684) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread count: 6 {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:03:51 devstack cinder-volume[76684]: DEBUG cinder.volume.manager [None req-5cca1a3f-931e-40d5-bf65-b01e4cf42f8c None None] thread info: [<_MainThread(MainThread, started 125575948001408)>, , , , , ] {{(pid=76684) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:03:54 devstack cinder-volume[76549]: INFO oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Caught SIGTERM, stopping children Jul 21 19:03:54 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Acquiring lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:03:54 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Acquired lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:03:54 devstack cinder-volume[76549]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Releasing lock "singleton_lock" {{(pid=76549) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:03:54 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Stop services. {{(pid=76549) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 19:03:54 devstack cinder-volume[76549]: DEBUG oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Killing children. {{(pid=76549) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 19:03:54 devstack cinder-volume[76549]: INFO oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Waiting on 1 children to exit Jul 21 19:03:59 devstack cinder-volume[76684]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Acquiring lock "singleton_lock" {{(pid=76684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:03:59 devstack cinder-volume[76684]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Acquired lock "singleton_lock" {{(pid=76684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:03:59 devstack cinder-volume[76684]: DEBUG oslo_concurrency.lockutils [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Releasing lock "singleton_lock" {{(pid=76684) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:03:59 devstack cinder-volume[76684]: WARNING amqp [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:03:59 devstack cinder-volume[76684]: WARNING amqp [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:03:59 devstack cinder-volume[76549]: INFO oslo_service.backend._eventlet.service [None req-cf42e7ce-c867-4eca-af1c-34e1f120f119 None None] Child 76684 exited with status 0 Jul 21 19:04:00 devstack cinder-volume[86801]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 19:04:00 devstack cinder-volume[86801]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:04:00 devstack cinder-volume[86801]: we strongly recommend against using it for new projects. Jul 21 19:04:00 devstack cinder-volume[86801]: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:04:00 devstack cinder-volume[86801]: framework. For more detail see Jul 21 19:04:00 devstack cinder-volume[86801]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:04:00 devstack cinder-volume[86801]: import eventlet # noqa Jul 21 19:04:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:04:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:04:02 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:04:02 devstack cinder-volume[86801]: INFO dbcounter [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Registered counter for database cinder Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG dbcounter [-] [86801] Writer thread running {{(pid=86801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:04:03 devstack cinder-volume[86801]: INFO cinder.rpc [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 19:04:03 devstack cinder-volume[86801]: INFO cinder.rpc [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Determined volume DB was empty at startup. Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG cinder.volume.manager [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86801) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 19:04:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 19:04:03 devstack cinder-volume[86801]: WARNING stevedore.named [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 19:04:03 devstack cinder-volume[86801]: WARNING castellan.key_manager [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:04:03 devstack cinder-volume[86801]: WARNING cinder.keymgr.conf_key_mgr [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:04:03 devstack cinder-volume[86801]: INFO cinder.volume.manager [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_db.sqlalchemy.engines [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:03 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Starting 1 workers Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Started child 87040 {{(pid=86801) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Full set of CONF: {{(pid=86801) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Configuration options gathered from: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] ================================================================================ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 19:04:03 devstack cinder-volume[87040]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] allow_availability_zone_fallback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] allow_compression_on_image_upload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] allowed_direct_url_schemes = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] api_rate_limit = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] auth_strategy = keystone {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_stats_polling_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backup_api_class = cinder.backup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backup_name_template = backup-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backup_use_same_host = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_internal_tenant_project_id = 63bf582b072c48c8a18015de3c5daf9d {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_internal_tenant_user_id = c992beec879f4052b7f72efd81e78458 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cluster = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] compression_format = gzip {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] compute_api_class = cinder.compute.nova.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] config_dir = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] config_source = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] control_exchange = openstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] debug = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] default_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] default_group_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] default_volume_type = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] enable_new_services = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] enabled_backends = ['QuobyteHD'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_api_insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_api_ssl_compression = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_ca_certificates_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_catalog_info = image:glance:publicURL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_num_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance_request_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] graceful_shutdown_timeout = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] group_api_class = cinder.group.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] host = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_compress_on_upload = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_conversion_address_space_limit = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_conversion_cpu_limit = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_conversion_disable = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] init_host_max_objects_retrieval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] instance_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iser_ip_address = 192.168.122.177 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_color = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_config_append = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_options = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_rotate_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_rotate_interval_type = days {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] log_rotation_type = none {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 19:04:03 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.remotefs [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87040) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] max_age = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] max_logfile_count = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] max_logfile_size_mb = 200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] message_reap_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] message_ttl = 2592000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] migration_create_volume_timeout_secs = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] monkey_patch = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] monkey_patch_modules = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] my_ip = 192.168.122.177 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] no_snapshot_gb_quota = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_max_limit = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_ext_list = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_listen_port = 8776 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] osapi_volume_workers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] per_volume_size_limit = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] periodic_fuzzy_delay = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] periodic_interval = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] public_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] publish_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_backup_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_backups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_gigabytes = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_groups = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_snapshots = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] quota_volumes = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] rate_limit_burst = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] rate_limit_except_level = CRITICAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] rate_limit_interval = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] reinit_driver_count = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] report_interval = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] reservation_clean_interval = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] reservation_expire = 86400 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] reserved_image_namespaces = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] rpc_response_timeout = 120 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] run_external_periodic_tasks = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_down_time = 720 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] shell_completion = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] snapshot_name_template = snapshot-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] state_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] storage_availability_zone = nova {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] syslog_log_facility = LOG_USER {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_helper = lioadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_ip_address = 192.168.122.177 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] until_refresh = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_default_quota_class = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_journal = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_json = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_stderr = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] use_syslog = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] verify_glance_signatures = enabled {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_api_class = cinder.volume.api.API {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_name_template = volume-%s {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_service_inithost_offload = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volume_usage_audit_period = month {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] zoning_mode = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_concurrency.disable_process_locking = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:03 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.auth_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.include_service_catalog = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.interface = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_password = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcache_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.service_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.backend = dogpile.cache.null {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.backend_argument = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.backend_expiration_time = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.config_prefix = cache.oslo {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.debug_cache_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.enable_retry_client = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.enable_socket_keepalive = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.expiration_time = 600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.hashclient_retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_dead_retry = 300 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_pool_maxsize = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_sasl_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.proxies = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.redis_db = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.redis_server = localhost:6379 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.retry_attempts = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.retry_delay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.socket_keepalive_count = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.socket_keepalive_idle = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.socket_keepalive_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.socket_timeout = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.tls_allowed_ciphers = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.tls_cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.tls_certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.tls_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.tls_keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cache.username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] coordination.backend_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.asyncio_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.asyncio_slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.backend = sqlalchemy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.connection_debug = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.connection_parameters = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.connection_recycle_time = 3600 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.connection_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.db_inc_retry_interval = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.db_max_retries = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.db_max_retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.db_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.max_overflow = 50 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.max_pool_size = 5 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.max_retries = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.mysql_wsrep_sync_wait = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.pool_timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.retry_interval = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.slave_connection = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.sqlite_synchronous = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.synchronous_reader = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] database.use_db_reconnect = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.connection_string = messaging:// {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.es_doc_type = notification {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.es_scroll_size = 10000 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.es_scroll_time = 2m {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.filter_error_trace = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.hmac_keys = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.sentinel_service_name = mymaster {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.socket_timeout = 0.1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.trace_requests = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler.trace_sqlalchemy = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler_jaeger.process_tags = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler_jaeger.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] profiler_otlp.service_name_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.enforce_new_defaults = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.policy_default_rule = default {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.policy_file = policy.yaml {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] privsep_osbrick.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.group = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.helper_command = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] cinder_sys_admin.user = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.send_service_user_token = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.auth_type = password {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] glance.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.chap_username = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.driver_use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.extra_capabilities = {} {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iscsi_target_flags = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iscsi_write_cache = on {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iser_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iser_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_host = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_login = admin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_private_key = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_share_path = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.num_shell_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.quobyte_volume_url = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.report_discard_supported = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.reserved_percentage = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_helper = tgtadm {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_port = 3260 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_protocol = iscsi {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.unique_fqdn_network = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.use_chap_auth = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_backend_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_clear = zero {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_clear_size = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_reports.file_event_handler = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_reports.log_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.backend_availability_zone = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.backend_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.chap_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.chap_username = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.chiscsi_conf = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.disk_geometry = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_client_cert = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_data_namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.driver_use_ssl = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.extra_capabilities = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.filter_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.goodness_function = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iser_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iser_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iser_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.iser_target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_host = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_login = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_mount_options = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_password = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_private_key = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_share_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_ssh_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.num_shell_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.nvmet_port_id = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87040) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[87040]: WARNING cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[87040]: WARNING cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.replication_device = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.report_discard_supported = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.reserved_percentage = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.scst_target_driver = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.storage_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_helper = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_ip_address = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_port = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_prefix = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_protocol = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.trace_flags = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.use_chap_auth = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_clear = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_clear_size = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] QuobyteHD.volumes_dir = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Running cmd (subprocess): mount.quobyte {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_notifications.driver = [] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_notifications.retry = -1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] key_manager.fixed_key = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.barbican_api_version = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.barbican_endpoint = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.barbican_endpoint_type = public {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.barbican_region_name = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.number_of_retries = 60 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.retry_delay = 1 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.send_service_user_token = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.verify_ssl = True {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican.verify_ssl_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.auth_section = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.auth_type = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.cafile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.certfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.collect_timing = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.insecure = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.keyfile = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.split_loggers = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] barbican_service_user.timeout = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.approle_role_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.approle_secret_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.auth_method = approle {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.auth_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.kv_mountpoint = secret {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.kv_path = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.kv_version = 2 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.namespace = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.root_token_id = **** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.ssl_ca_crt_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.timeout = 60.0 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.token_file = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.token_role = None {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.use_ssl = False {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:04 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 -c /etc/quobyte/client-cinder.cfg Jul 21 19:04:04 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] ******************************************************************************** {{(pid=86801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 19:04:04 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87040) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:04 devstack cinder-volume[87040]: INFO cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 ... Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 -c /etc/quobyte/client-cinder.cfg {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:04 devstack cinder-volume[87040]: INFO cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 succeeded Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87040) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.432s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:04 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:04 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:04 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.245s {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:04 devstack cinder-volume[87040]: INFO cinder.volume.driver [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG cinder.volume.driver [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7384033203125, 'free_capacity_gb': 1775.7384033203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87040) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG oslo_db.sqlalchemy.engines [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:04 devstack cinder-volume[87040]: DEBUG dbcounter [-] [87040] Writer thread running {{(pid=87040) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.db.api [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Building query based on filter {{(pid=87040) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.image.image_utils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87040) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.keymgr.migration [None req-25dc1e9b-7122-4784-a5ad-7e1ae4066bf0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87040) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87040) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:05 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:05 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:05 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.276s {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Notifying Schedulers of capabilities ... {{(pid=87040) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Driver initialization completed successfully. Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Initiating service 3 cleanup Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Service 3 cleanup completed. Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.service [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Creating RPC server for service cinder-volume {{(pid=87040) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.service [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87040) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87040) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG cinder.volume.drivers.quobyte [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87040) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87040) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:05 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:05 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:05 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:05 devstack cinder-volume[87040]: DEBUG oslo_concurrency.processutils [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.276s {{(pid=87040) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:05 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-9b5cd434-fafb-41a9-a76b-70abfb73dd94 None None] Driver post RPC initialization completed successfully. Jul 21 19:04:07 devstack cinder-volume[87040]: DEBUG oslo_service.periodic_task [None req-f3365ead-2534-4f3d-a704-81c612485440 None None] Running periodic task VolumeManager._thread_info {{(pid=87040) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:07 devstack cinder-volume[87040]: DEBUG cinder.volume.manager [None req-f3365ead-2534-4f3d-a704-81c612485440 None None] thread count: 6 {{(pid=87040) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:04:07 devstack cinder-volume[87040]: DEBUG cinder.volume.manager [None req-f3365ead-2534-4f3d-a704-81c612485440 None None] thread info: [<_MainThread(MainThread, started 131565796225152)>, , , , , ] {{(pid=87040) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:04:09 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Caught SIGTERM, stopping children Jul 21 19:04:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Acquiring lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:04:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Acquired lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:04:09 devstack cinder-volume[86801]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Releasing lock "singleton_lock" {{(pid=86801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:04:09 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Stop services. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 19:04:09 devstack cinder-volume[86801]: DEBUG oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Killing children. {{(pid=86801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 19:04:09 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Waiting on 1 children to exit Jul 21 19:04:09 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Acquiring lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:04:09 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Acquired lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:04:09 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Releasing lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:04:09 devstack cinder-volume[87040]: WARNING amqp [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:04:09 devstack cinder-volume[87040]: WARNING amqp [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 19:04:09 devstack cinder-volume[86801]: INFO oslo_service.backend._eventlet.service [None req-0849eb2e-0066-4122-b27a-4d7cd3d4c35f None None] Child 87040 exited with status 0 Jul 21 19:04:10 devstack cinder-volume[87408]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 19:04:10 devstack cinder-volume[87408]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:04:10 devstack cinder-volume[87408]: we strongly recommend against using it for new projects. Jul 21 19:04:10 devstack cinder-volume[87408]: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:04:10 devstack cinder-volume[87408]: framework. For more detail see Jul 21 19:04:10 devstack cinder-volume[87408]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:04:10 devstack cinder-volume[87408]: import eventlet # noqa Jul 21 19:04:12 devstack cinder-volume[87408]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 19:04:12 devstack cinder-volume[87408]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 19:04:12 devstack cinder-volume[87408]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 19:04:12 devstack cinder-volume[87408]: INFO dbcounter [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Registered counter for database cinder Jul 21 19:04:12 devstack cinder-volume[87408]: DEBUG oslo_db.sqlalchemy.engines [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG dbcounter [-] [87408] Writer thread running {{(pid=87408) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:04:13 devstack cinder-volume[87408]: INFO cinder.rpc [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 19:04:13 devstack cinder-volume[87408]: INFO cinder.rpc [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_db.sqlalchemy.engines [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:13 devstack cinder-volume[87408]: INFO cinder.volume.manager [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Determined volume DB was empty at startup. Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG cinder.volume.manager [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87408) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 19:04:13 devstack cinder-volume[87408]: WARNING stevedore.named [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 19:04:13 devstack cinder-volume[87408]: WARNING castellan.key_manager [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:04:13 devstack cinder-volume[87408]: WARNING cinder.keymgr.conf_key_mgr [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 19:04:13 devstack cinder-volume[87408]: INFO cinder.volume.manager [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_db.sqlalchemy.engines [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:13 devstack cinder-volume[87408]: INFO oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Starting 1 workers Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Started child 87498 {{(pid=87408) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Full set of CONF: {{(pid=87408) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] ******************************************************************************** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] Configuration options gathered from: {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] ================================================================================ {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] allow_availability_zone_fallback = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] allow_compression_on_image_upload = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] allowed_direct_url_schemes = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] api_rate_limit = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] auth_strategy = keystone {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_availability_zone = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_host = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_stats_polling_interval = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backup_api_class = cinder.backup.api.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backup_name_template = backup-%s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backup_use_same_host = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backup_use_temp_snapshot = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] chap_password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] chap_username = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87498]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_internal_tenant_project_id = 63bf582b072c48c8a18015de3c5daf9d {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_internal_tenant_user_id = c992beec879f4052b7f72efd81e78458 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cluster = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] compression_format = gzip {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] compute_api_class = cinder.compute.nova.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] config_dir = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] config_source = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] control_exchange = openstack {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] debug = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] default_availability_zone = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] default_group_type = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] default_volume_type = QuobyteHD {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] disk_geometry = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_client_cert = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_client_cert_key = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_data_namespace = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_ssl_cert_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_ssl_cert_verify = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] driver_use_ssl = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] enable_new_services = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] enable_unsupported_driver = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] enabled_backends = ['QuobyteHD'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] enforce_multipath_for_image_xfer = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] filter_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_api_insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_api_ssl_compression = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_ca_certificates_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_catalog_info = image:glance:publicURL {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_num_retries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance_request_timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] goodness_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] graceful_shutdown_timeout = 5 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] group_api_class = cinder.group.api.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] host = devstack {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_compress_on_upload = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_conversion_address_space_limit = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_conversion_cpu_limit = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_conversion_disable = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_upload_use_cinder_backend = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_upload_use_internal_tenant = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_volume_cache_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_volume_cache_max_count = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] image_volume_cache_max_size_gb = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] init_host_max_objects_retrieval = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] instance_format = [instance: %(uuid)s] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iscsi_target_flags = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iscsi_write_cache = on {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iser_helper = tgtadm {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iser_ip_address = 192.168.122.177 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iser_port = 3260 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_color = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_config_append = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_dir = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_options = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_rotate_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_rotate_interval_type = days {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] log_rotation_type = none {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] max_age = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] max_logfile_count = 30 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] max_logfile_size_mb = 200 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] max_over_subscription_ratio = 20.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] message_reap_interval = 86400 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] message_ttl = 2592000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] migration_create_volume_timeout_secs = 300 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] monkey_patch = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] monkey_patch_modules = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] my_ip = 192.168.122.177 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] no_snapshot_gb_quota = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] num_iser_scan_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] num_shell_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] num_volume_device_scan_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] nvmeof_conn_info_version = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] nvmet_ns_id = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] nvmet_port_id = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_max_limit = 1000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_ext_list = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_listen_port = 8776 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_use_ssl = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] osapi_volume_workers = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] per_volume_size_limit = -1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] periodic_fuzzy_delay = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] periodic_interval = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] public_endpoint = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] publish_errors = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_backup_gigabytes = 1000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_backups = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_gigabytes = 1000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_groups = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_snapshots = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] quota_volumes = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] rate_limit_burst = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] rate_limit_except_level = CRITICAL {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] rate_limit_interval = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] reinit_driver_count = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] replication_device = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] report_discard_supported = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] report_interval = 120 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] reservation_clean_interval = 86400 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] reservation_expire = 86400 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] reserved_image_namespaces = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] reserved_percentage = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] rpc_response_timeout = 120 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] run_external_periodic_tasks = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] scst_target_driver = iscsi {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] scst_target_iqn_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_down_time = 720 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] shell_completion = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] snapshot_name_template = snapshot-%s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] split_loggers = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] state_path = /opt/stack/data/cinder {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] storage_availability_zone = nova {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] storage_protocol = iSCSI {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] syslog_log_facility = LOG_USER {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_helper = lioadm {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_ip_address = 192.168.122.177 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_port = 3260 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_protocol = iscsi {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] target_secondary_ip_addresses = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] trace_flags = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] transport_url = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] until_refresh = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_chap_auth = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_default_quota_class = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_journal = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_json = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_multipath_for_image_xfer = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_stderr = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] use_syslog = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] verify_glance_signatures = enabled {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_api_class = cinder.volume.api.API {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_backend_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_clear = zero {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_clear_ionice = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_clear_size = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_copy_bps_limit = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_dd_blocksize = 1M {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_name_template = volume-%s {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_service_inithost_offload = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volume_usage_audit_period = month {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] zoning_mode = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_concurrency.disable_process_locking = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Starting volume driver QuobyteDriver (1.2) Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87498) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.auth_section = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.auth_type = password {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.auth_version = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.cache = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.include_service_catalog = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.interface = public {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_password = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcache_username = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.region_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.service_type = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.backend = dogpile.cache.null {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.backend_argument = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.backend_expiration_time = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.config_prefix = cache.oslo {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.debug_cache_backend = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.enable_retry_client = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.enable_socket_keepalive = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.expiration_time = 600 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.hashclient_retry_attempts = 2 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_dead_retry = 300 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_pool_maxsize = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_sasl_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.proxies = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.redis_db = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.redis_server = localhost:6379 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.retry_attempts = 2 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.retry_delay = 0.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.socket_keepalive_count = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.socket_keepalive_idle = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.socket_keepalive_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.socket_timeout = 1.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.tls_allowed_ciphers = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.tls_cafile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.tls_certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.tls_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.tls_keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cache.username = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] coordination.backend_url = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.asyncio_connection = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.asyncio_slave_connection = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.backend = sqlalchemy {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.connection = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.connection_debug = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.connection_parameters = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.connection_recycle_time = 3600 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.connection_trace = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.db_inc_retry_interval = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.db_max_retries = 20 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.db_max_retry_interval = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.db_retry_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.max_overflow = 50 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.max_pool_size = 5 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.max_retries = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.mysql_wsrep_sync_wait = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.pool_timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.retry_interval = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.slave_connection = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.sqlite_synchronous = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.synchronous_reader = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] database.use_db_reconnect = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.connection_string = messaging:// {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.es_doc_type = notification {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.es_scroll_size = 10000 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.es_scroll_time = 2m {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.filter_error_trace = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.hmac_keys = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.sentinel_service_name = mymaster {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.socket_timeout = 0.1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.trace_requests = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler.trace_sqlalchemy = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler_jaeger.process_tags = {} {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler_jaeger.service_name_prefix = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] profiler_otlp.service_name_prefix = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.enforce_new_defaults = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.policy_default_rule = default {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.policy_file = policy.yaml {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.group = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.helper_command = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] privsep_osbrick.user = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.group = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.helper_command = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] cinder_sys_admin.user = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.auth_section = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.auth_type = password {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.cafile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.collect_timing = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.send_service_user_token = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.split_loggers = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] service_user.timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.auth_section = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.auth_type = password {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.collect_timing = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.region_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.split_loggers = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] glance.timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.backend_availability_zone = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.chap_password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.chap_username = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.disk_geometry = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_client_cert = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_client_cert_key = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_data_namespace = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.driver_use_ssl = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.extra_capabilities = {} {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.filter_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.goodness_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iscsi_target_flags = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iscsi_write_cache = on {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iser_helper = tgtadm {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iser_port = 3260 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_host = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_login = admin {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_mount_options = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_private_key = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_share_path = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.num_shell_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.quobyte_volume_url = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.replication_device = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.report_discard_supported = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.reserved_percentage = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_helper = tgtadm {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_port = 3260 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_protocol = iscsi {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.trace_flags = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.unique_fqdn_network = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.use_chap_auth = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_backend_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_clear = zero {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_clear_ionice = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_clear_size = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_reports.file_event_handler = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_reports.log_dir = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.backend_availability_zone = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.backend_host = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.chap_password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.chap_username = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.chiscsi_conf = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.disk_geometry = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_client_cert = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_data_namespace = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.driver_use_ssl = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.extra_capabilities = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.filter_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.goodness_function = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87498) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iser_helper = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iser_ip_address = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iser_port = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.iser_target_prefix = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Running cmd (subprocess): mount.quobyte {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_host = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_login = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_mount_options = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_password = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_private_key = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_share_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_ssh_port = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.num_shell_tries = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.nvmet_port_id = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.replication_device = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.report_discard_supported = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.reserved_percentage = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.scst_target_driver = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.storage_protocol = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_helper = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_ip_address = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_port = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_prefix = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_protocol = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.trace_flags = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.use_chap_auth = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_clear = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_clear_size = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] QuobyteHD.volumes_dir = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_notifications.driver = [] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_notifications.retry = -1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] key_manager.fixed_key = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.barbican_api_version = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.barbican_endpoint = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.barbican_endpoint_type = public {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.barbican_region_name = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.cafile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.collect_timing = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.number_of_retries = 60 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.retry_delay = 1 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.send_service_user_token = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.split_loggers = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.verify_ssl = True {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican.verify_ssl_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.auth_section = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.auth_type = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.cafile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.certfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.collect_timing = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.insecure = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.keyfile = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.split_loggers = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] barbican_service_user.timeout = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.approle_role_id = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.approle_secret_id = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.auth_method = approle {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.auth_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.kv_mountpoint = secret {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.kv_path = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.kv_version = 2 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.namespace = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.root_token_id = **** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.ssl_ca_crt_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.timeout = 60.0 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.token_file = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.token_role = None {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.use_ssl = False {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 19:04:13 devstack cinder-volume[87408]: DEBUG oslo_service.backend._eventlet.service [None req-721362f9-d3a0-442d-b003-b3dbb8fbed80 None None] ******************************************************************************** {{(pid=87408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 19:04:13 devstack quobyte-client[87499]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 19:04:13 devstack quobyte-client[87499]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:13 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:13 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:13 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:13 devstack cinder-volume[87498]: INFO cinder.volume.driver [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Driver hasn't implemented _init_vendor_properties() Jul 21 19:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.driver [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7378044128418, 'free_capacity_gb': 1775.7378044128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_db.sqlalchemy.engines [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writer thread running {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.db.api [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Building query based on filter {{(pid=87498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.keymgr.migration [None req-7a3b31af-a425-4d04-96c8-7b69b0ff5357 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 19:04:14 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:14 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:14 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Driver initialization completed successfully. Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Initiating service 3 cleanup Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Service 3 cleanup completed. Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.service [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Creating RPC server for service cinder-volume {{(pid=87498) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.service [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87498) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:04:14 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:04:14 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:04:14 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Jul 21 19:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.221s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:04:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399965f0-cb32-4ff2-83b5-da0941fcd89b None None] Driver post RPC initialization completed successfully. Jul 21 19:04:23 devstack cinder-volume[87408]: DEBUG dbcounter [-] [87408] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87408) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:04:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 6 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:05:25 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:05:25 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:05:25 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 6 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:05:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:06:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:06:25 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:06:25 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:06:26 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Jul 21 19:06:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:06:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Flow 'volume_create_manager' (fce66610-8a93-4557-9592-4f7254724dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a73035d-0048-4524-8c26-f96408eefcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a73035d-0048-4524-8c26-f96408eefcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-890747029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5379da-ed72-4a72-bd29-5c502c3e301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d165ad2144c24d9599c79e2a1f791806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:03Z,use_quota=True,user_id='ae01a253566745888098a10d07e33e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be156d-6abd-4364-be9d-eee18ed567a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be156d-6abd-4364-be9d-eee18ed567a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90d9dda-d8b9-4b75-b02d-144b19ee666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90d9dda-d8b9-4b75-b02d-144b19ee666b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5379da-ed72-4a72-bd29-5c502c3e301d', 'volume_name': 'volume-6b5379da-ed72-4a72-bd29-5c502c3e301d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202b692-caac-4aac-9f56-e37c37257979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202b692-caac-4aac-9f56-e37c37257979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15cc79d-573f-4123-bc98-fef3cec2f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Volume 6b5379da-ed72-4a72-bd29-5c502c3e301d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5379da-ed72-4a72-bd29-5c502c3e301d', 'volume_size': 1} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-890747029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5379da-ed72-4a72-bd29-5c502c3e301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d165ad2144c24d9599c79e2a1f791806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:03Z,use_quota=True,user_id='ae01a253566745888098a10d07e33e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Creating volume 6b5379da-ed72-4a72-bd29-5c502c3e301d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:07:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:03 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d 1073741824 Jul 21 19:07:03 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d 1073741824" returned: 0 in 1.811s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:05 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:05 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d Jul 21 19:07:05 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:06 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d" returned: 0 in 0.993s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] <== create_volume: return (2953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.963s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15cc79d-573f-4123-bc98-fef3cec2f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5379da-ed72-4a72-bd29-5c502c3e301d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1bbdae-5b5c-4b07-9dd4-d20c9a6154e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Volume volume-6b5379da-ed72-4a72-bd29-5c502c3e301d (6b5379da-ed72-4a72-bd29-5c502c3e301d): created successfully Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1bbdae-5b5c-4b07-9dd4-d20c9a6154e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Flow 'volume_create_manager' (fce66610-8a93-4557-9592-4f7254724dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-99b2b2b2-a7dd-4ded-b8f6-9a6dbd2c31b2 tempest-DeleteServersTestJSON-339958282 None] Created volume successfully. Jul 21 19:07:15 devstack cinder-volume[87498]: WARNING py.warnings [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 21 19:07:15 devstack cinder-volume[87498]: .first() Jul 21 19:07:15 devstack cinder-volume[87498]: Jul 21 19:07:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-6b5379da-ed72-4a72-bd29-5c502c3e301d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eae2cbde-bb38-41a5-bf77-a9918bcc8325', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:07:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-1e9ea720-8bad-468f-9e42-c60cf37e7aeb req-a44bf8ec-e920-4ca3-a643-ad34871c91d8 tempest-DeleteServersTestJSON-339958282 None] attachment_update completed successfully. Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Flow 'volume_create_manager' (fd3e4a19-c14f-4ab5-881d-141afd96fe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9feb0c-0caf-4c0c-92de-e15e85695714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9feb0c-0caf-4c0c-92de-e15e85695714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1833044194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381ff914-ec62-4139-97da-05a872a95561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39737e2cc34cf7b062df81f9d460c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:18Z,use_quota=True,user_id='c234dfaf3c594b43a03b45845378d1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696e213e-ca48-4965-a677-87ebc3d24f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696e213e-ca48-4965-a677-87ebc3d24f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c443c-36b5-4db8-b965-5d0f36e21ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c443c-36b5-4db8-b965-5d0f36e21ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381ff914-ec62-4139-97da-05a872a95561', 'volume_name': 'volume-381ff914-ec62-4139-97da-05a872a95561', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a947d6a7-076c-4815-b0fd-968cd446d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a947d6a7-076c-4815-b0fd-968cd446d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f2b2d2-e5f4-422d-894b-e4256f779241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Volume 381ff914-ec62-4139-97da-05a872a95561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381ff914-ec62-4139-97da-05a872a95561', 'volume_size': 1} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1833044194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381ff914-ec62-4139-97da-05a872a95561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39737e2cc34cf7b062df81f9d460c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:18Z,use_quota=True,user_id='c234dfaf3c594b43a03b45845378d1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Creating volume 381ff914-ec62-4139-97da-05a872a95561 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:07:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:18 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 1073741824 Jul 21 19:07:18 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 1073741824" returned: 0 in 0.982s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:19 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 Jul 21 19:07:19 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:19 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f2b2d2-e5f4-422d-894b-e4256f779241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381ff914-ec62-4139-97da-05a872a95561', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f23cee9-a94a-4228-877a-dc462e6eae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Volume volume-381ff914-ec62-4139-97da-05a872a95561 (381ff914-ec62-4139-97da-05a872a95561): created successfully Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f23cee9-a94a-4228-877a-dc462e6eae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Flow 'volume_create_manager' (fd3e4a19-c14f-4ab5-881d-141afd96fe99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7ac6fdc3-1341-454c-9120-45c7efc7bccc tempest-VolumesAdminNegativeTest-1056358724 None] Created volume successfully. Jul 21 19:07:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Acquiring lock "cinder-381ff914-ec62-4139-97da-05a872a95561-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "cinder-381ff914-ec62-4139-97da-05a872a95561-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Acquiring lock "cinder-quobyte-381ff914-ec62-4139-97da-05a872a95561" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "cinder-quobyte-381ff914-ec62-4139-97da-05a872a95561" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:22 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcxb_8zps/privsep.sock'] Jul 21 19:07:22 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcxb_8zps/privsep.sock Jul 21 19:07:22 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-bdbda80f-e56e-46b5-b366-60ca7a695845 req-102562ed-550e-46f0-8c9a-35dc0c3f4151 tempest-DeleteServersTestJSON-339958282 None] Terminate volume connection completed successfully. Jul 21 19:07:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bdbda80f-e56e-46b5-b366-60ca7a695845 req-102562ed-550e-46f0-8c9a-35dc0c3f4151 tempest-DeleteServersTestJSON-339958282 None] Deleting attachment eae2cbde-bb38-41a5-bf77-a9918bcc8325. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 19:07:24 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 19:07:25 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:25 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Spawned new privsep daemon via rootwrap Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Accepted privsep connection to /tmp/tmpcxb_8zps/privsep.sock {{(pid=87498) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 19:07:25 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 19:07:25 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 19:07:25 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 19:07:25 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89570 Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd9067-ed9c-450f-912f-a66d99175932]: (2,) {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555d017-427d-4f40-aca7-d43726677901]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 Jul 21 19:07:25 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:25 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:07:25 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "cinder-6b5379da-ed72-4a72-bd29-5c502c3e301d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "cinder-6b5379da-ed72-4a72-bd29-5c502c3e301d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:26 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561" returned: 0 in 1.009s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "cinder-quobyte-6b5379da-ed72-4a72-bd29-5c502c3e301d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:26 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561 Jul 21 19:07:26 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "cinder-quobyte-6b5379da-ed72-4a72-bd29-5c502c3e301d" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.642s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2a8884-cecd-4457-8870-b10c9d19f03c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:26 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d Jul 21 19:07:26 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:26 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-381ff914-ec62-4139-97da-05a872a95561" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "cinder-quobyte-381ff914-ec62-4139-97da-05a872a95561" released by "delete_volume" :: held 4.439s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:26 devstack cinder-volume[87498]: WARNING cinder.quota [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:26 devstack cinder-volume[87498]: WARNING cinder.quota [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Created reservations ['69820806-e084-42b3-a1b4-2829a20d32a8', 'c6230fee-9834-4834-b923-36ba362a94ae', '05ac1288-1b69-4b50-8fc8-2cf27d94c2d8', '6254391b-675a-42c1-a3db-1ccf169dbeb1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:26 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d" returned: 0 in 0.574s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d Jul 21 19:07:27 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:27 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:07:27 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:27 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6b5379da-ed72-4a72-bd29-5c502c3e301d" returned: 0 in 0.579s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "cinder-quobyte-6b5379da-ed72-4a72-bd29-5c502c3e301d" released by "delete_volume" :: held 1.265s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:27 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Deleted volume successfully. Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Created reservations ['37a842b8-cead-423a-ba5b-6947168668e7', '8589ab9b-59a2-498f-ba2f-596703b8db37', '887b7bca-4efd-488d-8373-361ee1681600', '74f85406-a2fb-4015-a212-767a9db910aa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94447bd8-41c4-460e-8631-aa78d58e6c17 tempest-VolumesAdminNegativeTest-1056358724 None] Lock "cinder-381ff914-ec62-4139-97da-05a872a95561-delete_volume" released by "delete_volume" :: held 5.806s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:28 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:07:28 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:28 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Deleted volume successfully. Jul 21 19:07:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ee9f8ff-4df6-426d-9364-ac65c245e990 tempest-DeleteServersTestJSON-339958282 None] Lock "cinder-6b5379da-ed72-4a72-bd29-5c502c3e301d-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Flow 'volume_create_manager' (67f7281f-36a8-4f70-aa14-1e9a35d02bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d62449f-9872-4a63-833c-96e8256a0aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d62449f-9872-4a63-833c-96e8256a0aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2004181654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67b98d8-4fcf-4e92-b614-fb08d59e2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c33d41b02cd427a8d23f58489b88980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:31Z,use_quota=True,user_id='bc762d8c2d1e40a7914d00085df948ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff89cba7-9a35-45aa-bf7a-6aaf11ef76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff89cba7-9a35-45aa-bf7a-6aaf11ef76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4ced60-493f-4206-a56e-cb540b2e8a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4ced60-493f-4206-a56e-cb540b2e8a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67b98d8-4fcf-4e92-b614-fb08d59e2d66', 'volume_name': 'volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9232f2cc-0fe6-4b71-bf5a-4e9c7ede2285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9232f2cc-0fe6-4b71-bf5a-4e9c7ede2285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f25b83-2e0e-450c-be82-bee4dbd3afc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Volume c67b98d8-4fcf-4e92-b614-fb08d59e2d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66', 'volume_size': 1} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2004181654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67b98d8-4fcf-4e92-b614-fb08d59e2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c33d41b02cd427a8d23f58489b88980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:31Z,use_quota=True,user_id='bc762d8c2d1e40a7914d00085df948ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Creating volume c67b98d8-4fcf-4e92-b614-fb08d59e2d66 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:31 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 1073741824 Jul 21 19:07:31 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:31 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 1073741824" returned: 0 in 0.558s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:31 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 Jul 21 19:07:31 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:32 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f25b83-2e0e-450c-be82-bee4dbd3afc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0bcd0-f2a7-43b4-938b-203b71268e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Volume volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 (c67b98d8-4fcf-4e92-b614-fb08d59e2d66): created successfully Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0bcd0-f2a7-43b4-938b-203b71268e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Flow 'volume_create_manager' (67f7281f-36a8-4f70-aa14-1e9a35d02bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-abc8ca91-8f54-44ef-9ba7-37d866adf064 tempest-ServersNegativeTestJSON-1156336625 None] Created volume successfully. Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Flow 'volume_create_manager' (37791e27-8d42-4062-a964-e550e2141bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70914fc3-6125-48f1-95c8-2a00d84a4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70914fc3-6125-48f1-95c8-2a00d84a4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1359966273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf63a57-e735-418d-bf36-13744bb6ceaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c33d41b02cd427a8d23f58489b88980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:35Z,use_quota=True,user_id='bc762d8c2d1e40a7914d00085df948ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc6aa36-8460-478f-8c34-70655504c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc6aa36-8460-478f-8c34-70655504c85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f64e8-57d5-4687-9eb2-cc5591f90033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282f64e8-57d5-4687-9eb2-cc5591f90033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf63a57-e735-418d-bf36-13744bb6ceaa', 'volume_name': 'volume-4bf63a57-e735-418d-bf36-13744bb6ceaa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82c5b0e-0b5a-4d1e-abe4-0f7747d61051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82c5b0e-0b5a-4d1e-abe4-0f7747d61051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cbd00d-6459-448d-a7f8-4bd43118583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Volume 4bf63a57-e735-418d-bf36-13744bb6ceaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf63a57-e735-418d-bf36-13744bb6ceaa', 'volume_size': 1} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1359966273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf63a57-e735-418d-bf36-13744bb6ceaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c33d41b02cd427a8d23f58489b88980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:07:35Z,use_quota=True,user_id='bc762d8c2d1e40a7914d00085df948ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Creating volume 4bf63a57-e735-418d-bf36-13744bb6ceaa {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:07:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:35 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa 1073741824 Jul 21 19:07:35 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:35 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa 1073741824" returned: 0 in 0.678s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:36 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa Jul 21 19:07:36 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:36 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cbd00d-6459-448d-a7f8-4bd43118583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf63a57-e735-418d-bf36-13744bb6ceaa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330c51b-fd3a-491b-a3fd-188628eb559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:07:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Volume volume-4bf63a57-e735-418d-bf36-13744bb6ceaa (4bf63a57-e735-418d-bf36-13744bb6ceaa): created successfully Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5330c51b-fd3a-491b-a3fd-188628eb559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:07:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Flow 'volume_create_manager' (37791e27-8d42-4062-a964-e550e2141bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:07:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eec846dc-6f01-4b65-92c8-47b907644dcf tempest-ServersNegativeTestJSON-1156336625 None] Created volume successfully. Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "cinder-4bf63a57-e735-418d-bf36-13744bb6ceaa-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-4bf63a57-e735-418d-bf36-13744bb6ceaa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "cinder-quobyte-4bf63a57-e735-418d-bf36-13744bb6ceaa" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-quobyte-4bf63a57-e735-418d-bf36-13744bb6ceaa" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb7d81-0fc4-4c66-bc0e-62776a5f4bcf]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa Jul 21 19:07:40 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:40 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa Jul 21 19:07:40 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:40 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4bf63a57-e735-418d-bf36-13744bb6ceaa" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-quobyte-4bf63a57-e735-418d-bf36-13744bb6ceaa" released by "delete_volume" :: held 0.694s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Created reservations ['d8a83f1a-741c-43a2-ab2d-750b7d90e090', 'ddbb4346-63f0-4ad7-981b-3ed45a0ee4ce', '3f2209cc-f1bd-40ee-a4c6-325d20847473', '37aa7a4e-88bd-480b-9e6c-3a80659ee46d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:07:41 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "cinder-c67b98d8-4fcf-4e92-b614-fb08d59e2d66-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-c67b98d8-4fcf-4e92-b614-fb08d59e2d66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "cinder-quobyte-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-quobyte-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:07:41 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Deleted volume successfully. Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe77d89-4468-4fab-9bfd-9af8ad650863]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e461664-113e-4de4-8b54-2cf4340d286d tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-4bf63a57-e735-418d-bf36-13744bb6ceaa-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:41 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 Jul 21 19:07:41 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:41 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:41 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66 Jul 21 19:07:41 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:42 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-quobyte-c67b98d8-4fcf-4e92-b614-fb08d59e2d66" released by "delete_volume" :: held 0.744s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Created reservations ['76adbab0-6684-4730-a4b3-8729393742ed', '6b259759-791a-4697-b87b-3999d977d853', 'f0b532e2-2888-4563-8b15-b2612e8811ea', 'cf7b80de-cb32-4d1f-a31a-bb5498e00517'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:07:42 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:07:42 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:07:42 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:07:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Deleted volume successfully. Jul 21 19:07:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-32881134-36b9-4742-9668-0c6152f648ce tempest-ServersNegativeTestJSON-1156336625 None] Lock "cinder-c67b98d8-4fcf-4e92-b614-fb08d59e2d66-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:07:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=43,cinder:SELECT=36,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:07:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=35,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Flow 'volume_create_manager' (c560ca1f-8d5f-4b10-9c90-257b1f8d133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d05cac-e5bf-4efa-bb9e-4257232ebb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d05cac-e5bf-4efa-bb9e-4257232ebb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-152919279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4716a827-8251-42e7-b9ba-14d685510e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12384b51df91481b8f1dba6be59d5eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:08Z,use_quota=True,user_id='35d6a910b6fb496998c837a02d13a542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea9aa46-1c82-4bdd-9b56-47fa4a1e23de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea9aa46-1c82-4bdd-9b56-47fa4a1e23de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b101ad9-608a-4206-8caa-d5fade36e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b101ad9-608a-4206-8caa-d5fade36e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4716a827-8251-42e7-b9ba-14d685510e61', 'volume_name': 'volume-4716a827-8251-42e7-b9ba-14d685510e61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b798ded2-cd32-4f4b-ae98-1da747a8c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b798ded2-cd32-4f4b-ae98-1da747a8c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130cbc25-501c-4227-9eff-c3597575d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Volume 4716a827-8251-42e7-b9ba-14d685510e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4716a827-8251-42e7-b9ba-14d685510e61', 'volume_size': 1} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-152919279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4716a827-8251-42e7-b9ba-14d685510e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12384b51df91481b8f1dba6be59d5eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:08Z,use_quota=True,user_id='35d6a910b6fb496998c837a02d13a542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Creating volume 4716a827-8251-42e7-b9ba-14d685510e61 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:08:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:08 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 1073741824 Jul 21 19:08:08 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 1073741824" returned: 0 in 0.578s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:09 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 Jul 21 19:08:09 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:09 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130cbc25-501c-4227-9eff-c3597575d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4716a827-8251-42e7-b9ba-14d685510e61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08202519-d15b-4797-b409-7c7114f22c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Volume volume-4716a827-8251-42e7-b9ba-14d685510e61 (4716a827-8251-42e7-b9ba-14d685510e61): created successfully Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08202519-d15b-4797-b409-7c7114f22c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Flow 'volume_create_manager' (c560ca1f-8d5f-4b10-9c90-257b1f8d133d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9768955b-2c46-40f5-8586-2e6db1bb415e tempest-TaggedAttachmentsTest-1521729611 None] Created volume successfully. Jul 21 19:08:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:24 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:25 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:08:25 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:26 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:08:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:08:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:08:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:08:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:08:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Flow 'volume_create_manager' (9b73da12-e93c-43d6-af10-c8850bad7954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247afe5d-5858-426c-92ee-5aeb1069e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247afe5d-5858-426c-92ee-5aeb1069e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-592030882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ba90e4-8cca-49b4-b597-89aa6f81b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed717f1bffe4923bde1516e8e51acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:52Z,use_quota=True,user_id='c95ea6bef28c4fe8834c121a80e9b22f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8def1e10-fa3d-4b2b-82ee-ef5efb76477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8def1e10-fa3d-4b2b-82ee-ef5efb76477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b641e-cdf3-4a52-bfd5-d942e580e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2b641e-cdf3-4a52-bfd5-d942e580e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ba90e4-8cca-49b4-b597-89aa6f81b052', 'volume_name': 'volume-41ba90e4-8cca-49b4-b597-89aa6f81b052', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e673e295-6cce-4f25-a7dd-dfa272e9a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e673e295-6cce-4f25-a7dd-dfa272e9a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9688182f-6eb3-4b2c-87bb-53ef205bbe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Volume 41ba90e4-8cca-49b4-b597-89aa6f81b052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ba90e4-8cca-49b4-b597-89aa6f81b052', 'volume_size': 1} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-592030882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ba90e4-8cca-49b4-b597-89aa6f81b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed717f1bffe4923bde1516e8e51acf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:08:52Z,use_quota=True,user_id='c95ea6bef28c4fe8834c121a80e9b22f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Creating volume 41ba90e4-8cca-49b4-b597-89aa6f81b052 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:08:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 1073741824 Jul 21 19:08:52 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 1073741824" returned: 0 in 0.505s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:08:52 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 Jul 21 19:08:52 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:08:52 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9688182f-6eb3-4b2c-87bb-53ef205bbe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ba90e4-8cca-49b4-b597-89aa6f81b052', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe4240e-c2ae-418b-bb60-e55dc3e58428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:08:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Volume volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 (41ba90e4-8cca-49b4-b597-89aa6f81b052): created successfully Jul 21 19:08:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe4240e-c2ae-418b-bb60-e55dc3e58428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:08:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Flow 'volume_create_manager' (9b73da12-e93c-43d6-af10-c8850bad7954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:08:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f948998b-e78a-4467-97f8-f57c25b5ce61 tempest-AttachVolumeShelveTestJSON-788672411 None] Created volume successfully. Jul 21 19:09:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-32b2e4cd-fbd7-4646-b075-05cea379f4ab req-63759707-00c1-45b3-b7b5-1a2221a77869 tempest-AttachVolumeShelveTestJSON-788672411 None] No connector for attachment 44ce8f1f-caf1-40ce-99ae-e18fa632040d; skipping storage backend terminate_connection call. {{(pid=87498) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 19:09:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-32b2e4cd-fbd7-4646-b075-05cea379f4ab req-63759707-00c1-45b3-b7b5-1a2221a77869 tempest-AttachVolumeShelveTestJSON-788672411 None] Deleting attachment 44ce8f1f-caf1-40ce-99ae-e18fa632040d. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:09:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bdc60cda-7d3a-4357-b98a-69601145ce95 req-7e7e2205-62a5-4f52-aa01-c55c283326c9 tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bdc60cda-7d3a-4357-b98a-69601145ce95 req-7e7e2205-62a5-4f52-aa01-c55c283326c9 tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bdc60cda-7d3a-4357-b98a-69601145ce95 req-7e7e2205-62a5-4f52-aa01-c55c283326c9 tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bdc60cda-7d3a-4357-b98a-69601145ce95 req-7e7e2205-62a5-4f52-aa01-c55c283326c9 tempest-TaggedAttachmentsTest-1521729611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-4716a827-8251-42e7-b9ba-14d685510e61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28388415-f166-497a-a091-7b2e03426c28', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-bdc60cda-7d3a-4357-b98a-69601145ce95 req-7e7e2205-62a5-4f52-aa01-c55c283326c9 tempest-TaggedAttachmentsTest-1521729611 None] attachment_update completed successfully. Jul 21 19:09:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6585eac8-92d0-425d-95e0-3f6027c62647 req-3c8fc052-3630-47a2-9477-71e07d035a7d tempest-TaggedAttachmentsTest-1521729611 None] Terminate volume connection completed successfully. Jul 21 19:09:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6585eac8-92d0-425d-95e0-3f6027c62647 req-3c8fc052-3630-47a2-9477-71e07d035a7d tempest-TaggedAttachmentsTest-1521729611 None] Deleting attachment 28388415-f166-497a-a091-7b2e03426c28. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:09:23 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:23 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (2b477ffd-0489-4a3a-a54e-a2a7755e16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42db2cd-a413-4cd1-8328-055bc7b8f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42db2cd-a413-4cd1-8328-055bc7b8f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1114936881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78e1f79-c592-494f-ae39-a3d2654df77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:24Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59f361b-3fc6-49d5-83a4-0da85cbbe785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59f361b-3fc6-49d5-83a4-0da85cbbe785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f4fa6a-e2f1-41c8-a8f1-ba3145ef8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f4fa6a-e2f1-41c8-a8f1-ba3145ef8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78e1f79-c592-494f-ae39-a3d2654df77b', 'volume_name': 'volume-f78e1f79-c592-494f-ae39-a3d2654df77b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a13abf1-5981-4b18-9f46-c1afc7f2bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a13abf1-5981-4b18-9f46-c1afc7f2bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad98b9c7-ac56-4ff5-9142-a03e218ffe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Volume f78e1f79-c592-494f-ae39-a3d2654df77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78e1f79-c592-494f-ae39-a3d2654df77b', 'volume_size': 1} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1114936881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78e1f79-c592-494f-ae39-a3d2654df77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:24Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Creating volume f78e1f79-c592-494f-ae39-a3d2654df77b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:09:24 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b 1073741824 Jul 21 19:09:24 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (fae47596-8b17-4f52-9102-e37f4b151d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d25e18e-d1fe-4477-af74-d3ba723bbf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "cinder-4716a827-8251-42e7-b9ba-14d685510e61-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d25e18e-d1fe-4477-af74-d3ba723bbf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-153346271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ced50b-067e-4e85-a76c-1106d3c7b6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:24Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490c6124-2be0-43fb-8b17-79fce9fa164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490c6124-2be0-43fb-8b17-79fce9fa164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33ba7ce-e430-4e11-849f-fcb6513a6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33ba7ce-e430-4e11-849f-fcb6513a6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ced50b-067e-4e85-a76c-1106d3c7b6cc', 'volume_name': 'volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a60127-7347-4d73-a0f8-c37e60f480db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a60127-7347-4d73-a0f8-c37e60f480db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12a931a-b1aa-443a-af05-04197086a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Volume b6ced50b-067e-4e85-a76c-1106d3c7b6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc', 'volume_size': 1} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "cinder-4716a827-8251-42e7-b9ba-14d685510e61-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "cinder-quobyte-4716a827-8251-42e7-b9ba-14d685510e61" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "cinder-quobyte-4716a827-8251-42e7-b9ba-14d685510e61" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b35686-a32b-40dd-a538-e3008dc0de87]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 Jul 21 19:09:24 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:24 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b 1073741824" returned: 0 in 0.584s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b Jul 21 19:09:24 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:24 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:24 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61 Jul 21 19:09:24 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:25 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-153346271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ced50b-067e-4e85-a76c-1106d3c7b6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:09:24Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Creating volume b6ced50b-067e-4e85-a76c-1106d3c7b6cc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:09:25 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad98b9c7-ac56-4ff5-9142-a03e218ffe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78e1f79-c592-494f-ae39-a3d2654df77b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797847ec-cf63-47bd-8786-53dc6df264cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:25 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc 1073741824 Jul 21 19:09:25 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Volume volume-f78e1f79-c592-494f-ae39-a3d2654df77b (f78e1f79-c592-494f-ae39-a3d2654df77b): created successfully Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797847ec-cf63-47bd-8786-53dc6df264cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (2b477ffd-0489-4a3a-a54e-a2a7755e16e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:25 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4716a827-8251-42e7-b9ba-14d685510e61" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "cinder-quobyte-4716a827-8251-42e7-b9ba-14d685510e61" released by "delete_volume" :: held 0.792s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-382378ac-65b5-4ad3-867b-0e37113eb9f8 tempest-AttachVolumeNegativeTest-1762307697 None] Created volume successfully. Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Created reservations ['d9f6829f-eefb-45d8-91ed-bfdb3088ad77', 'e5609a6c-9f31-4d07-8daf-e6d1e128b971', '278f01a7-546f-4921-8336-007484721149', '33c4634d-c5e2-4a9a-9c0e-1dc0db8a487c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:25 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:09:25 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:25 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc 1073741824" returned: 0 in 0.702s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:25 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:25 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:25 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Deleted volume successfully. Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1115e48b-78c9-4877-b77e-6c21c826945a tempest-TaggedAttachmentsTest-1521729611 None] Lock "cinder-4716a827-8251-42e7-b9ba-14d685510e61-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:25 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc Jul 21 19:09:25 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:26 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:09:26 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12a931a-b1aa-443a-af05-04197086a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdc616-6cde-448f-9e49-4ef1d76f1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:09:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Volume volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc (b6ced50b-067e-4e85-a76c-1106d3c7b6cc): created successfully Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdc616-6cde-448f-9e49-4ef1d76f1503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (fae47596-8b17-4f52-9102-e37f4b151d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:09:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-040cba66-2b26-4785-8077-49ea86347be5 tempest-AttachVolumeTestJSON-1274736618 None] Created volume successfully. Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6c55483e-d2dc-4383-b47c-07bfaf44eb70 req-86430d6c-7567-457e-901d-0472ffdf7637 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6c55483e-d2dc-4383-b47c-07bfaf44eb70 req-86430d6c-7567-457e-901d-0472ffdf7637 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6c55483e-d2dc-4383-b47c-07bfaf44eb70 req-86430d6c-7567-457e-901d-0472ffdf7637 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6c55483e-d2dc-4383-b47c-07bfaf44eb70 req-86430d6c-7567-457e-901d-0472ffdf7637 tempest-AttachVolumeNegativeTest-1762307697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-f78e1f79-c592-494f-ae39-a3d2654df77b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3977a7b-beeb-4301-b7c1-c69a5531f529', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6c55483e-d2dc-4383-b47c-07bfaf44eb70 req-86430d6c-7567-457e-901d-0472ffdf7637 tempest-AttachVolumeNegativeTest-1762307697 None] attachment_update completed successfully. Jul 21 19:09:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c4db3e36-630a-4552-b7d1-7f56ecea4d5f req-1761276c-3fcf-44e0-95c2-3cf83763d16a tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c4db3e36-630a-4552-b7d1-7f56ecea4d5f req-1761276c-3fcf-44e0-95c2-3cf83763d16a tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c4db3e36-630a-4552-b7d1-7f56ecea4d5f req-1761276c-3fcf-44e0-95c2-3cf83763d16a tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-c4db3e36-630a-4552-b7d1-7f56ecea4d5f req-1761276c-3fcf-44e0-95c2-3cf83763d16a tempest-AttachVolumeTestJSON-1274736618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6254c94c-ffa8-4c8f-ae9c-6563cea7d671', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:09:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-c4db3e36-630a-4552-b7d1-7f56ecea4d5f req-1761276c-3fcf-44e0-95c2-3cf83763d16a tempest-AttachVolumeTestJSON-1274736618 None] attachment_update completed successfully. Jul 21 19:09:38 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:38 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=16,cinder:SELECT=22,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Acquiring lock "cinder-41ba90e4-8cca-49b4-b597-89aa6f81b052-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "cinder-41ba90e4-8cca-49b4-b597-89aa6f81b052-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Acquiring lock "cinder-quobyte-41ba90e4-8cca-49b4-b597-89aa6f81b052" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "cinder-quobyte-41ba90e4-8cca-49b4-b597-89aa6f81b052" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac588d-83a4-4896-a91a-9284adf4a3e4]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:09:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:51 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 Jul 21 19:09:51 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:52 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052" returned: 0 in 0.868s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:52 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052 Jul 21 19:09:52 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:52 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-41ba90e4-8cca-49b4-b597-89aa6f81b052" returned: 0 in 0.581s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "cinder-quobyte-41ba90e4-8cca-49b4-b597-89aa6f81b052" released by "delete_volume" :: held 1.563s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Created reservations ['5d502f5b-ea14-41de-9dda-40d05d24e175', 'ea3c9f35-eb49-42eb-8e08-dd863181a145', 'a18c697c-7de6-4adf-82b9-8148a82ceb62', '2d06823c-a2d4-4ac5-93ea-f13138dd44a1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:09:53 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:09:53 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:09:53 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:09:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Deleted volume successfully. Jul 21 19:09:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c97b64b-8bc7-4f12-a27f-b2d43fdb9a5d tempest-AttachVolumeShelveTestJSON-788672411 None] Lock "cinder-41ba90e4-8cca-49b4-b597-89aa6f81b052-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Flow 'volume_create_manager' (7b534dce-feea-4111-9b21-9513edbc2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8f127e-04c8-43af-9f07-11472b636ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8f127e-04c8-43af-9f07-11472b636ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1450455299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46a33f5-70e4-481a-ac40-5704deb2da9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3373c931454a7491e861c24cc4fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:05Z,use_quota=True,user_id='8cf95fd74d9b4f0083c845dcd3da67a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f6e20-6ab6-4fc1-8981-c883f8eeaaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22f6e20-6ab6-4fc1-8981-c883f8eeaaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e766eb-ed00-4b4a-b0d7-03a06489bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e766eb-ed00-4b4a-b0d7-03a06489bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46a33f5-70e4-481a-ac40-5704deb2da9e', 'volume_name': 'volume-c46a33f5-70e4-481a-ac40-5704deb2da9e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6882748c-bfcb-4d58-8003-6b44c25b6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6882748c-bfcb-4d58-8003-6b44c25b6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6175d1-89ff-4ea2-8f36-027d9014cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Volume c46a33f5-70e4-481a-ac40-5704deb2da9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46a33f5-70e4-481a-ac40-5704deb2da9e', 'volume_size': 1} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1450455299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46a33f5-70e4-481a-ac40-5704deb2da9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd3373c931454a7491e861c24cc4fa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:05Z,use_quota=True,user_id='8cf95fd74d9b4f0083c845dcd3da67a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Creating volume c46a33f5-70e4-481a-ac40-5704deb2da9e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:05 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e 1073741824 Jul 21 19:10:05 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:06 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e 1073741824" returned: 0 in 0.742s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:06 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e Jul 21 19:10:06 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:06 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6175d1-89ff-4ea2-8f36-027d9014cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46a33f5-70e4-481a-ac40-5704deb2da9e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543380d4-1217-45e8-b78d-aec66e3458d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Volume volume-c46a33f5-70e4-481a-ac40-5704deb2da9e (c46a33f5-70e4-481a-ac40-5704deb2da9e): created successfully Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543380d4-1217-45e8-b78d-aec66e3458d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Flow 'volume_create_manager' (7b534dce-feea-4111-9b21-9513edbc2194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-09c0c5b3-792d-4a7c-ba88-e0f0ee1f05ce req-52f28209-5f60-4124-b330-c26b5c649e94 tempest-VolumesGetTestJSON-1570283515 None] Created volume successfully. Jul 21 19:10:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Acquiring lock "cinder-c46a33f5-70e4-481a-ac40-5704deb2da9e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "cinder-c46a33f5-70e4-481a-ac40-5704deb2da9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Acquiring lock "cinder-quobyte-c46a33f5-70e4-481a-ac40-5704deb2da9e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "cinder-quobyte-c46a33f5-70e4-481a-ac40-5704deb2da9e" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7bb4a1-a114-422b-b6f9-644614ca9c41]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:08 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e Jul 21 19:10:08 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:08 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:08 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e Jul 21 19:10:08 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:09 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c46a33f5-70e4-481a-ac40-5704deb2da9e" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "cinder-quobyte-c46a33f5-70e4-481a-ac40-5704deb2da9e" released by "delete_volume" :: held 1.022s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.quota [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Created reservations ['2634bd11-f0f5-4f55-9b11-c376e46559ac', '3682de39-b4a4-43c7-a768-541d6e515f60', '212a1992-5f48-4041-85db-047fc65c6a1a', '4b162570-ba0b-46e3-8b96-39c28419f592'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:09 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:10:09 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:09 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.manager [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Deleted volume successfully. Jul 21 19:10:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-69a51c54-e3db-440d-b4fa-6b6e41b92098 req-653b693e-2386-439e-921c-28174b8e1a6c tempest-VolumesGetTestJSON-1570283515 None] Lock "cinder-c46a33f5-70e4-481a-ac40-5704deb2da9e-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d60d6aec-d602-4f2d-ba63-925837b7c984 req-2fd36d97-8900-4e30-abe6-7cf44c218087 tempest-AttachVolumeNegativeTest-1762307697 None] Terminate volume connection completed successfully. Jul 21 19:10:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d60d6aec-d602-4f2d-ba63-925837b7c984 req-2fd36d97-8900-4e30-abe6-7cf44c218087 tempest-AttachVolumeNegativeTest-1762307697 None] Deleting attachment f3977a7b-beeb-4301-b7c1-c69a5531f529. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (367a14e2-8114-4bc2-b948-3004efd61db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464f2d82-5154-4480-b886-5bd422a7edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464f2d82-5154-4480-b886-5bd422a7edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1408230369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a7eb43-88a6-42b6-be59-ee47d541d610,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:15Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52b9c6b-fc56-48be-9ba7-bdd715cf6e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52b9c6b-fc56-48be-9ba7-bdd715cf6e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d414a068-8db9-4e1c-9db1-ad995520a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d414a068-8db9-4e1c-9db1-ad995520a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a7eb43-88a6-42b6-be59-ee47d541d610', 'volume_name': 'volume-26a7eb43-88a6-42b6-be59-ee47d541d610', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319b2bb5-6359-4f58-ab21-7f577116a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319b2bb5-6359-4f58-ab21-7f577116a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef29f3d-2403-4ebe-8a98-c70186185fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Volume 26a7eb43-88a6-42b6-be59-ee47d541d610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a7eb43-88a6-42b6-be59-ee47d541d610', 'volume_size': 1} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1408230369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a7eb43-88a6-42b6-be59-ee47d541d610,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:15Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Creating volume 26a7eb43-88a6-42b6-be59-ee47d541d610 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:15 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 1073741824 Jul 21 19:10:15 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:16 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 1073741824" returned: 0 in 0.674s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:16 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 Jul 21 19:10:16 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:16 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef29f3d-2403-4ebe-8a98-c70186185fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a7eb43-88a6-42b6-be59-ee47d541d610', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9dbdf1-806f-4cd2-989b-d3f2221a4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Volume volume-26a7eb43-88a6-42b6-be59-ee47d541d610 (26a7eb43-88a6-42b6-be59-ee47d541d610): created successfully Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9dbdf1-806f-4cd2-989b-d3f2221a4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (367a14e2-8114-4bc2-b948-3004efd61db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-092935b1-cc5e-41d5-ab05-0c36575b615b tempest-VolumesTestJSON-142020832 None] Created volume successfully. Jul 21 19:10:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-e468d890-36a8-46fb-941e-0a35f5c5d1bb req-ebd7e8ad-f335-43a0-822c-92341ff9e8fb tempest-AttachVolumeTestJSON-1274736618 None] Terminate volume connection completed successfully. Jul 21 19:10:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-e468d890-36a8-46fb-941e-0a35f5c5d1bb req-ebd7e8ad-f335-43a0-822c-92341ff9e8fb tempest-AttachVolumeTestJSON-1274736618 None] Deleting attachment 6254c94c-ffa8-4c8f-ae9c-6563cea7d671. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (4bdc916c-fa18-4b56-949e-b4f40041646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7047cd-203e-462c-b7b0-96314357012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7047cd-203e-462c-b7b0-96314357012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-857051058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73414141-3ee7-4461-bdcf-2d17a11476aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:18Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67b01bc-01d9-4440-a52c-ecf374296de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67b01bc-01d9-4440-a52c-ecf374296de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a25155-92f1-4cff-a2d0-ff1c9f7fac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a25155-92f1-4cff-a2d0-ff1c9f7fac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73414141-3ee7-4461-bdcf-2d17a11476aa', 'volume_name': 'volume-73414141-3ee7-4461-bdcf-2d17a11476aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318a2c18-475f-46b6-8d5e-69f90010a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318a2c18-475f-46b6-8d5e-69f90010a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a937cb4f-77ee-40f3-aad6-2de8024862c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Volume 73414141-3ee7-4461-bdcf-2d17a11476aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73414141-3ee7-4461-bdcf-2d17a11476aa', 'volume_size': 1} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-857051058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73414141-3ee7-4461-bdcf-2d17a11476aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:18Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Creating volume 73414141-3ee7-4461-bdcf-2d17a11476aa {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:18 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa 1073741824 Jul 21 19:10:18 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:18 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa 1073741824" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:19 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa Jul 21 19:10:19 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:19 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a937cb4f-77ee-40f3-aad6-2de8024862c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73414141-3ee7-4461-bdcf-2d17a11476aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231c7e52-800e-4ce7-9446-4eb1a8881ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Volume volume-73414141-3ee7-4461-bdcf-2d17a11476aa (73414141-3ee7-4461-bdcf-2d17a11476aa): created successfully Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231c7e52-800e-4ce7-9446-4eb1a8881ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (4bdc916c-fa18-4b56-949e-b4f40041646f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2a30fab3-5b5c-4aa7-b86c-00dedd1333c5 tempest-VolumesTestJSON-142020832 None] Created volume successfully. Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (e9ac2598-44ab-4574-ac0b-04b1027f00f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd2872d-79cb-4b44-ae76-ba52f41069f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd2872d-79cb-4b44-ae76-ba52f41069f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472463469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb937644-d081-46e8-8148-790373fef816,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:21Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43ea72d-63c8-4e1b-904a-caf6deac4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43ea72d-63c8-4e1b-904a-caf6deac4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8f5f36-a3e3-453b-98db-a12ef3dd5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8f5f36-a3e3-453b-98db-a12ef3dd5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb937644-d081-46e8-8148-790373fef816', 'volume_name': 'volume-eb937644-d081-46e8-8148-790373fef816', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6261fd-e91e-4e5a-9a9a-463ba7c16c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6261fd-e91e-4e5a-9a9a-463ba7c16c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59dee91-7b3c-45e4-8278-7f2547c269e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Volume eb937644-d081-46e8-8148-790373fef816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb937644-d081-46e8-8148-790373fef816', 'volume_size': 1} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472463469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb937644-d081-46e8-8148-790373fef816,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5fb857e363be4df9b870d6d712c71c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:21Z,use_quota=True,user_id='5c6c1219f2d34bbc86211735310e9912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Creating volume eb937644-d081-46e8-8148-790373fef816 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:21 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 1073741824 Jul 21 19:10:21 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:21 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 1073741824" returned: 0 in 0.552s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:21 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 Jul 21 19:10:21 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:22 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59dee91-7b3c-45e4-8278-7f2547c269e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb937644-d081-46e8-8148-790373fef816', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a086d792-2f5b-427c-a290-9416923bb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Volume volume-eb937644-d081-46e8-8148-790373fef816 (eb937644-d081-46e8-8148-790373fef816): created successfully Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a086d792-2f5b-427c-a290-9416923bb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Flow 'volume_create_manager' (e9ac2598-44ab-4574-ac0b-04b1027f00f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0503a908-92db-4590-a2b0-e9b91b4f544d tempest-VolumesTestJSON-142020832 None] Created volume successfully. Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-eb937644-d081-46e8-8148-790373fef816-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "cinder-eb937644-d081-46e8-8148-790373fef816-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-quobyte-eb937644-d081-46e8-8148-790373fef816" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-eb937644-d081-46e8-8148-790373fef816" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e48d539-12ca-4371-8bba-c8423b030d0e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:24 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 Jul 21 19:10:24 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:25 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:25 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816 Jul 21 19:10:25 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:25 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eb937644-d081-46e8-8148-790373fef816" returned: 0 in 0.505s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:25 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:10:25 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-eb937644-d081-46e8-8148-790373fef816" released by "delete_volume" :: held 1.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Created reservations ['f972ba0e-2e6e-45bd-975b-d59f1a27445e', '17b8716a-e129-429c-bef4-67543a401fd2', 'a212b0ff-ef6a-4bf3-a987-e85af02b0ef2', '671cb730-e5a7-4e8d-8062-b4e0deb0b8a2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:26 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:10:26 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:26 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:10:26 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.616s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Deleted volume successfully. Jul 21 19:10:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d4e63f3-aa8f-48eb-ac56-d8b9b9f5e767 tempest-VolumesTestJSON-142020832 None] Lock "cinder-eb937644-d081-46e8-8148-790373fef816-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-73414141-3ee7-4461-bdcf-2d17a11476aa-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "cinder-73414141-3ee7-4461-bdcf-2d17a11476aa-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-quobyte-73414141-3ee7-4461-bdcf-2d17a11476aa" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-73414141-3ee7-4461-bdcf-2d17a11476aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[63596a74-26b1-40c4-8c1f-131cf1183f2e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:27 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa Jul 21 19:10:27 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa" returned: 0 in 0.630s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa Jul 21 19:10:28 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:28 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-73414141-3ee7-4461-bdcf-2d17a11476aa" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-73414141-3ee7-4461-bdcf-2d17a11476aa" released by "delete_volume" :: held 1.161s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Created reservations ['797a7679-1411-4efb-b255-40f2e647906e', '093460c8-040e-4638-b324-fccc51181f8c', '59bc0ac4-1240-4d14-b34f-fd2305e1aba4', '09eaa83c-4d2b-4953-b4c5-b287f34753e2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:28 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:10:28 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Deleted volume successfully. Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5172b5ff-d7db-47d7-a14c-04e4b4eebf1e tempest-VolumesTestJSON-142020832 None] Lock "cinder-73414141-3ee7-4461-bdcf-2d17a11476aa-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Flow 'volume_create_manager' (9dda2919-d39d-4519-917e-2d4a089f9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699309f9-2b69-4d71-a5c8-14b9f13692b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-26a7eb43-88a6-42b6-be59-ee47d541d610-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699309f9-2b69-4d71-a5c8-14b9f13692b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-981207228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296607cc-ad09-4e07-80d6-f65fb3a0d95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e3653178134763be6f04b9c6da0d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:30Z,use_quota=True,user_id='2e372704ae454d99a9582aa3621482ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be497487-faef-47a9-9f46-d22ac97dc27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be497487-faef-47a9-9f46-d22ac97dc27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f3f244-b5fd-421e-a16a-1be76df7f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f3f244-b5fd-421e-a16a-1be76df7f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'volume_name': 'volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002d9f0f-403c-4987-98fe-a31c153a6f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002d9f0f-403c-4987-98fe-a31c153a6f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a48e64f-bb8e-476d-9aa4-29604e412e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Volume 296607cc-ad09-4e07-80d6-f65fb3a0d95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'volume_size': 1} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-981207228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296607cc-ad09-4e07-80d6-f65fb3a0d95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e3653178134763be6f04b9c6da0d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:30Z,use_quota=True,user_id='2e372704ae454d99a9582aa3621482ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Creating volume 296607cc-ad09-4e07-80d6-f65fb3a0d95b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "cinder-26a7eb43-88a6-42b6-be59-ee47d541d610-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:29 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b 1073741824 Jul 21 19:10:29 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Acquiring lock "cinder-quobyte-26a7eb43-88a6-42b6-be59-ee47d541d610" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-26a7eb43-88a6-42b6-be59-ee47d541d610" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b46c94-a8dc-462d-acbf-0db32a47df62]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:30 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 Jul 21 19:10:30 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:30 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b 1073741824" returned: 0 in 0.888s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:30 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610" returned: 0 in 0.790s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:30 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b Jul 21 19:10:30 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:30 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610 Jul 21 19:10:30 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:31 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:31 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a48e64f-bb8e-476d-9aa4-29604e412e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2aa948-98a1-44ae-b1d5-99feeba96082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-26a7eb43-88a6-42b6-be59-ee47d541d610" returned: 0 in 0.778s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "cinder-quobyte-26a7eb43-88a6-42b6-be59-ee47d541d610" released by "delete_volume" :: held 1.666s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Volume volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b (296607cc-ad09-4e07-80d6-f65fb3a0d95b): created successfully Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2aa948-98a1-44ae-b1d5-99feeba96082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Flow 'volume_create_manager' (9dda2919-d39d-4519-917e-2d4a089f9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f3878de0-bb0f-4dbd-a082-605889fce2c5 tempest-ServerActionsTestOtherA-962255443 None] Created volume successfully. Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Created reservations ['6015597b-feaa-417e-9aef-1d728f82c69b', '154e4872-df21-4033-a89e-a29c90d58485', 'b4d32d93-64e1-40b2-9d0d-669cd62507cb', '2a1e787d-a40a-492c-9c89-eab9cbf41447'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:32 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:10:32 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:32 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.695s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:10:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Deleted volume successfully. Jul 21 19:10:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff765cc-e42d-42f3-b024-303595d37116 tempest-VolumesTestJSON-142020832 None] Lock "cinder-26a7eb43-88a6-42b6-be59-ee47d541d610-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:10:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da2e46a2-3492-48e2-ae20-0dd2f07a1eaf tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-1756886055: creating Jul 21 19:10:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da2e46a2-3492-48e2-ae20-0dd2f07a1eaf tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-1756886055: created successfully Jul 21 19:10:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da2e46a2-3492-48e2-ae20-0dd2f07a1eaf tempest-GroupSnapshotsTest-1455482519 None] Create group completed successfully. Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (d88cb0df-3ec2-4e7d-aa07-b343084afd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc4e950-50fa-4d25-a6ec-7760558218e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc4e950-50fa-4d25-a6ec-7760558218e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861529762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e884efc8-e163-45c5-ba69-3dd475887390,host='devstack@QuobyteHD#QuobyteHD',id=c4e668a8-b995-45c0-9a66-f4194347a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:43Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71108b6-d78d-4c2a-9bb6-06d8e981e9a0),volume_type_id=e71108b6-d78d-4c2a-9bb6-06d8e981e9a0)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e1272-028e-4416-bd63-047ed2b603b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e1272-028e-4416-bd63-047ed2b603b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02c332f-aafd-4fd3-8e3c-2e78584fb61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02c332f-aafd-4fd3-8e3c-2e78584fb61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e668a8-b995-45c0-9a66-f4194347a10b', 'volume_name': 'volume-c4e668a8-b995-45c0-9a66-f4194347a10b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1f1ddb-1eb5-4819-83d6-ea32cfca1450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1f1ddb-1eb5-4819-83d6-ea32cfca1450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da28d0fb-3889-4229-ae7d-d9e987228b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Volume c4e668a8-b995-45c0-9a66-f4194347a10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e668a8-b995-45c0-9a66-f4194347a10b', 'volume_size': 1} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e884efc8-e163-45c5-ba69-3dd475887390,created_at=2026-07-21T17:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861529762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e884efc8-e163-45c5-ba69-3dd475887390,host='devstack@QuobyteHD#QuobyteHD',id=c4e668a8-b995-45c0-9a66-f4194347a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:43Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71108b6-d78d-4c2a-9bb6-06d8e981e9a0),volume_type_id=e71108b6-d78d-4c2a-9bb6-06d8e981e9a0)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Creating volume c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b 1073741824 Jul 21 19:10:43 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:43 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b 1073741824" returned: 0 in 0.672s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:43 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:10:43 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:44 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da28d0fb-3889-4229-ae7d-d9e987228b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e668a8-b995-45c0-9a66-f4194347a10b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1650fd6-39d7-4d28-a9bb-945d53ca8f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Volume volume-c4e668a8-b995-45c0-9a66-f4194347a10b (c4e668a8-b995-45c0-9a66-f4194347a10b): created successfully Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1650fd6-39d7-4d28-a9bb-945d53ca8f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (d88cb0df-3ec2-4e7d-aa07-b343084afd64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-287d1390-771a-4a4f-b7cc-575774dab3bf tempest-GroupSnapshotsTest-1455482519 None] Created volume successfully. Jul 21 19:10:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] GroupSnapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: creating. Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Group snapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Creating offline snapshot 23667c8e-659a-4a12-8a7b-caf7ecc97458 of volume c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274bb25-2368-4a6c-9ecf-dd8f417df092]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:10:46 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:46 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.537s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:46 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 1G Jul 21 19:10:46 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:47 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 1G" returned: 0 in 0.940s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e668a8-b995-45c0-9a66-f4194347a10b -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:47 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e668a8-b995-45c0-9a66-f4194347a10b -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:10:47 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:48 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e668a8-b995-45c0-9a66-f4194347a10b -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.522s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:10:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:48 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:10:48 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:48 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:48 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info Jul 21 19:10:48 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:49 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:10:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:49 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info Jul 21 19:10:49 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:49 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.info" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dcbca7b4-949a-4239-b373-916abe9b3080 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: created successfully Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458-3f00cb93-b844-462d-943e-4ef9decee4f7" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458-3f00cb93-b844-462d-943e-4ef9decee4f7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Creating volume 3f00cb93-b844-462d-943e-4ef9decee4f7 from snapshot 23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] snapshot: 23667c8e-659a-4a12-8a7b-caf7ecc97458, volume: 3f00cb93-b844-462d-943e-4ef9decee4f7, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[df491366-d61d-47ad-9906-061cfe12ba6f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:51 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:10:51 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:51 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e668a8-b995-45c0-9a66-f4194347a10b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe3b27-32d4-4a92-a60f-572cda00fe10]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:52 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:10:52 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:52 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:52 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:10:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:52 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 Jul 21 19:10:52 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7" returned: 0 in 7.022s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54eeaaa-609e-4650-b2e9-13c215f8b430]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (df778214-eda3-4864-9ad9-f1b4e3536c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0098b0-62f4-44af-af26-629d3753e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0098b0-62f4-44af-af26-629d3753e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1148849859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a960313-ad26-4358-a2d0-7b26ffbefef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:59Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f6198c-7a68-4ec3-b873-c2db3582ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:59 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f6198c-7a68-4ec3-b873-c2db3582ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:59 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6174b1cd-250d-4ce8-95a5-315a606969fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6174b1cd-250d-4ce8-95a5-315a606969fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a960313-ad26-4358-a2d0-7b26ffbefef2', 'volume_name': 'volume-6a960313-ad26-4358-a2d0-7b26ffbefef2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0739ce40-e438-48da-b1fc-662e2239ce55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0739ce40-e438-48da-b1fc-662e2239ce55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78457e92-665a-4042-bf54-e94bd54ce045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:10:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Volume 6a960313-ad26-4358-a2d0-7b26ffbefef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a960313-ad26-4358-a2d0-7b26ffbefef2', 'volume_size': 1} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:10:59 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:10:59 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Converted 1024.00 MB image at 145.78 MB/s Jul 21 19:10:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:10:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:10:59 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 Jul 21 19:10:59 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:00 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" released by "_copy_volume_from_snapshot" :: held 8.838s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458-3f00cb93-b844-462d-943e-4ef9decee4f7" released by "_create_volume_from_snapshot" :: held 8.884s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.909s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1148849859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a960313-ad26-4358-a2d0-7b26ffbefef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:10:59Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Creating volume 6a960313-ad26-4358-a2d0-7b26ffbefef2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:00 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 1073741824 Jul 21 19:11:00 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-babcdb9f-0f80-4dde-a3b2-93e4f79684e5 tempest-GroupSnapshotsTest-1455482519 None] Create group from source-snapshot-ef8da91a-29b3-41ff-85e6-9ed6d979f252 completed successfully. Jul 21 19:11:00 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 1073741824" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:00 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 Jul 21 19:11:00 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491da74-2439-46f9-8945-ad093dbe594d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:01 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:01 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 Jul 21 19:11:01 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78457e92-665a-4042-bf54-e94bd54ce045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a960313-ad26-4358-a2d0-7b26ffbefef2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b61fd6-d60f-43ec-9ba6-6c1c03a564d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Volume volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 (6a960313-ad26-4358-a2d0-7b26ffbefef2): created successfully Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b61fd6-d60f-43ec-9ba6-6c1c03a564d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (df778214-eda3-4864-9ad9-f1b4e3536c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-84bd25a2-f8fd-430e-abfa-9a8ec12288a3 tempest-AttachVolumeNegativeTest-1762307697 None] Created volume successfully. Jul 21 19:11:01 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:01 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7 Jul 21 19:11:01 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:01 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3f00cb93-b844-462d-943e-4ef9decee4f7" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-3f00cb93-b844-462d-943e-4ef9decee4f7" released by "delete_volume" :: held 0.906s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['f07bec5b-762e-43ad-bae9-552719516ee3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:02 devstack cinder-volume[87498]: WARNING cinder.quota [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2117388446 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2117388446, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:02 devstack cinder-volume[87498]: WARNING cinder.quota [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2117388446 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2117388446, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['cceb434e-f90a-41fd-95bf-ab3f8e492fdd', 'c39adbda-af5c-47d7-b6c7-c0968c1437aa', '6958b8c1-f975-42e6-8f9b-66ad9dee50d8', '0ca6d191-4370-422a-bd9a-3212fd1f5e0e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:02 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:02 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-affdf8b5-b8c3-4c26-a7bd-ba8dae3504dc req-53d46ea2-9fe6-4fd6-a462-a0f878881fdd tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-affdf8b5-b8c3-4c26-a7bd-ba8dae3504dc req-53d46ea2-9fe6-4fd6-a462-a0f878881fdd tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-affdf8b5-b8c3-4c26-a7bd-ba8dae3504dc req-53d46ea2-9fe6-4fd6-a462-a0f878881fdd tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-affdf8b5-b8c3-4c26-a7bd-ba8dae3504dc req-53d46ea2-9fe6-4fd6-a462-a0f878881fdd tempest-AttachVolumeNegativeTest-1762307697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-6a960313-ad26-4358-a2d0-7b26ffbefef2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb0d75c6-3797-4443-8f55-913e377936c2', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:02 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e1cfbc96-8799-4ac5-a4ed-95c0fbbc07c4 tempest-GroupSnapshotsTest-1455482519 None] Delete group completed successfully. Jul 21 19:11:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-affdf8b5-b8c3-4c26-a7bd-ba8dae3504dc req-53d46ea2-9fe6-4fd6-a462-a0f878881fdd tempest-AttachVolumeNegativeTest-1762307697 None] attachment_update completed successfully. Jul 21 19:11:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: deleting Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=62,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Deleting offline snapshot 23667c8e-659a-4a12-8a7b-caf7ecc97458 of volume c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] snapshot_file for this snap is: volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c35a7e0-6b75-4f8b-adf4-0ca65e2abcd2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:03 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:11:03 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:04 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e668a8-b995-45c0-9a66-f4194347a10b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084500c-7fe3-40aa-8f7f-ed1ff9936be5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:04 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:11:04 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:04 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.785s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:11:05 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:05 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.834s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:05 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458 Jul 21 19:11:05 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:06 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b.23667c8e-659a-4a12-8a7b-caf7ecc97458" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-23667c8e-659a-4a12-8a7b-caf7ecc97458" released by "_delete_snapshot" :: held 2.529s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" released by "delete_snapshot" :: held 2.579s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=68,cinder:UPDATE=65,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:11:06 devstack cinder-volume[87498]: WARNING cinder.quota [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2117388446 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2117388446, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['2336d96d-bdb2-4b4c-a9f9-fff18c3132bd', '7bbc0d1a-d886-4ce6-82c1-98414bfb5992', '81079d3d-7937-4d9d-a610-6620d028a746', 'd40c635f-d35f-4576-b365-0cf91bfd18ec'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-acacea4d-f592-443b-9d0a-e1cf0c1e53e0 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot ef8da91a-29b3-41ff-85e6-9ed6d979f252: deleted successfully Jul 21 19:11:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-630b15e7-3ca8-4504-b77d-4b450c6ab1c5 req-ae5c7af3-5df4-4679-b790-c004f21e0ae7 tempest-AttachVolumeNegativeTest-1762307697 None] Terminate volume connection completed successfully. Jul 21 19:11:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-630b15e7-3ca8-4504-b77d-4b450c6ab1c5 req-ae5c7af3-5df4-4679-b790-c004f21e0ae7 tempest-AttachVolumeNegativeTest-1762307697 None] Deleting attachment fb0d75c6-3797-4443-8f55-913e377936c2. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b983da-d4b2-40a8-920f-c4ed6d9a072c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:07 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:11:07 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.765s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:08 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b Jul 21 19:11:08 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:08 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4e668a8-b995-45c0-9a66-f4194347a10b" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-c4e668a8-b995-45c0-9a66-f4194347a10b" released by "delete_volume" :: held 1.470s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['36f89ca4-9416-4002-a7d3-f7ae6ab4ab0c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:09 devstack cinder-volume[87498]: WARNING cinder.db.api [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2117388446'] Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['d3bf89ae-e133-4c58-91fa-4c0029002890', 'b8014d5e-1ba4-4ae2-b5f1-3bcfa73a74b1', '1932e20a-4dc7-4f21-8ff1-e7dd5e612c5d', '515bac0a-40e0-46a7-8501-28aecb01e546'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:09 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:09 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:09 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a03a8f45-af62-456e-b199-3a36d3cbbaa4 tempest-GroupSnapshotsTest-1455482519 None] Delete group completed successfully. Jul 21 19:11:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-225ea56c-12aa-403e-b2a7-6716930af483 tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-1076956046: creating Jul 21 19:11:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-225ea56c-12aa-403e-b2a7-6716930af483 tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-1076956046: created successfully Jul 21 19:11:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-225ea56c-12aa-403e-b2a7-6716930af483 tempest-GroupSnapshotsTest-1455482519 None] Create group completed successfully. Jul 21 19:11:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-e0d98493-b009-4890-b1ec-45ebaeea2f3e req-2cae16b1-2bde-4b8e-bdd3-b2ed576fa8ad tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-e0d98493-b009-4890-b1ec-45ebaeea2f3e req-2cae16b1-2bde-4b8e-bdd3-b2ed576fa8ad tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-e0d98493-b009-4890-b1ec-45ebaeea2f3e req-2cae16b1-2bde-4b8e-bdd3-b2ed576fa8ad tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-e0d98493-b009-4890-b1ec-45ebaeea2f3e req-2cae16b1-2bde-4b8e-bdd3-b2ed576fa8ad tempest-ServerActionsTestOtherA-962255443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b87aea61-076d-4c05-968b-4b7ef236261d', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-e0d98493-b009-4890-b1ec-45ebaeea2f3e req-2cae16b1-2bde-4b8e-bdd3-b2ed576fa8ad tempest-ServerActionsTestOtherA-962255443 None] attachment_update completed successfully. Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (0a1d3336-421a-4e07-8a8a-7a0142d69258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af442ade-508f-481d-8c5d-6008417fff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af442ade-508f-481d-8c5d-6008417fff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535913387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,host='devstack@QuobyteHD#QuobyteHD',id=a7514d10-16c5-4c7f-bdab-f3abfb730736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:13Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511ddee5-758d-40de-86b9-561c489543b3),volume_type_id=511ddee5-758d-40de-86b9-561c489543b3)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0364e9-a5a9-4007-9e40-209b99b8fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0364e9-a5a9-4007-9e40-209b99b8fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9383d1f-5eca-4311-99db-7a266cd057f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9383d1f-5eca-4311-99db-7a266cd057f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7514d10-16c5-4c7f-bdab-f3abfb730736', 'volume_name': 'volume-a7514d10-16c5-4c7f-bdab-f3abfb730736', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0bcbc9-c4eb-4f6f-b7c0-b88207eaf175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0bcbc9-c4eb-4f6f-b7c0-b88207eaf175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e384965-6f66-4832-8bfc-08082cf00279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Volume a7514d10-16c5-4c7f-bdab-f3abfb730736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7514d10-16c5-4c7f-bdab-f3abfb730736', 'volume_size': 1} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,created_at=2026-07-21T17:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535913387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,host='devstack@QuobyteHD#QuobyteHD',id=a7514d10-16c5-4c7f-bdab-f3abfb730736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:13Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511ddee5-758d-40de-86b9-561c489543b3),volume_type_id=511ddee5-758d-40de-86b9-561c489543b3)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Creating volume a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:13 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 1073741824 Jul 21 19:11:13 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:13 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 1073741824" returned: 0 in 0.696s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:14 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 Jul 21 19:11:14 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:14 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e384965-6f66-4832-8bfc-08082cf00279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7514d10-16c5-4c7f-bdab-f3abfb730736', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fdb5a-0527-4735-80c7-24ede18848e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Volume volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 (a7514d10-16c5-4c7f-bdab-f3abfb730736): created successfully Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8fdb5a-0527-4735-80c7-24ede18848e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (0a1d3336-421a-4e07-8a8a-7a0142d69258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-830d07ee-4315-4280-880a-fb284f2420d8 tempest-GroupSnapshotsTest-1455482519 None] Created volume successfully. Jul 21 19:11:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-a56b101b-fc57-4729-86bd-303da04a494c tempest-ServerActionsTestOtherA-962255443 None] Terminate volume connection completed successfully. Jul 21 19:11:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-a56b101b-fc57-4729-86bd-303da04a494c tempest-ServerActionsTestOtherA-962255443 None] Deleting attachment b87aea61-076d-4c05-968b-4b7ef236261d. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (5ef92f38-90dc-4c43-a840-88cb53761baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e9c30-e615-4ccc-b98f-dcc53a7a8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e9c30-e615-4ccc-b98f-dcc53a7a8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,host='devstack@QuobyteHD#QuobyteHD',id=57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:17Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511ddee5-758d-40de-86b9-561c489543b3),volume_type_id=511ddee5-758d-40de-86b9-561c489543b3)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2656a2-f362-45c3-be25-b1f2653193e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2656a2-f362-45c3-be25-b1f2653193e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2234bc59-d361-442b-bc4b-7f146bd1fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2234bc59-d361-442b-bc4b-7f146bd1fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e', 'volume_name': 'volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a8d5e5-c97c-40cd-a835-3750b5a2432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a8d5e5-c97c-40cd-a835-3750b5a2432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720e6a5d-14a7-48d3-96bd-a0b0c215b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Volume 57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e', 'volume_size': 1} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,created_at=2026-07-21T17:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512289304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ae04b5-f106-4b5f-870f-a4c48567c6b6,host='devstack@QuobyteHD#QuobyteHD',id=57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:17Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511ddee5-758d-40de-86b9-561c489543b3),volume_type_id=511ddee5-758d-40de-86b9-561c489543b3)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Creating volume 57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:17 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:17 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e 1073741824 Jul 21 19:11:17 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:18 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e 1073741824" returned: 0 in 0.963s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-e914d36e-139f-41b2-9e55-cf1441762cf1 tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:18 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e Jul 21 19:11:18 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:18 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-e914d36e-139f-41b2-9e55-cf1441762cf1 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.432s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720e6a5d-14a7-48d3-96bd-a0b0c215b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d291a1-fd65-465e-9e41-b5f8e47b780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-e914d36e-139f-41b2-9e55-cf1441762cf1 tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Volume volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e (57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e): created successfully Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d291a1-fd65-465e-9e41-b5f8e47b780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (5ef92f38-90dc-4c43-a840-88cb53761baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3617425c-f7d5-411d-b778-ce9a7ebd6797 tempest-GroupSnapshotsTest-1455482519 None] Created volume successfully. Jul 21 19:11:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-e914d36e-139f-41b2-9e55-cf1441762cf1 tempest-ServerActionsTestOtherA-962255443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a307196-5783-410d-9b97-369ab1f1a017', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-5f38eb59-9241-43bc-93ea-a60159ce8099 req-e914d36e-139f-41b2-9e55-cf1441762cf1 tempest-ServerActionsTestOtherA-962255443 None] attachment_update completed successfully. Jul 21 19:11:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bf50e1a7-ba95-47ce-8204-99cd74e3acff tempest-GroupSnapshotsTest-1455482519 None] Update group completed successfully. Jul 21 19:11:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8978d984-b2d0-4a9f-85e5-40b251af08de tempest-GroupSnapshotsTest-1455482519 None] Update group completed successfully. Jul 21 19:11:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8513aada-93f5-4c5d-a786-ed5377f5c73d tempest-GroupSnapshotsTest-1455482519 None] Update group completed successfully. Jul 21 19:11:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8887cefa-b472-421e-84f6-77863b57701c tempest-GroupSnapshotsTest-1455482519 None] Update group completed successfully. Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:25 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:25 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:26 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:11:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] GroupSnapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: creating. Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Group snapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Creating offline snapshot bf98d3b1-a056-4285-8ffc-b4a37210a3a4 of volume 57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513507a-58d6-424d-a0eb-a245142345d1]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:26 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e Jul 21 19:11:26 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:27 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" returned: 0 in 0.962s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:27 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 1G Jul 21 19:11:27 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:28 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 1G" returned: 0 in 0.650s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 Jul 21 19:11:28 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:28 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:28 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:28 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 Jul 21 19:11:28 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:29 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:29 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info Jul 21 19:11:29 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:29 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:29 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:29 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info Jul 21 19:11:29 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:30 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.info" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.767s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Creating offline snapshot d770b4e8-9379-4e7b-b70f-1030ba4a98e2 of volume a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e076316-f55f-403b-b285-5c0e22b8bbc4]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:30 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 Jul 21 19:11:30 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:31 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:31 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 1G Jul 21 19:11:31 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:31 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 1G" returned: 0 in 0.666s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:31 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 Jul 21 19:11:31 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:32 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:32 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 Jul 21 19:11:32 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:32 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:32 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info Jul 21 19:11:32 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:32 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:32 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info Jul 21 19:11:32 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:33 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.info" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-82c67fb8-6bcf-45fa-bc27-85ab6ffdbc05 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: created successfully Jul 21 19:11:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: deleting Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-bf98d3b1-a056-4285-8ffc-b4a37210a3a4" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-bf98d3b1-a056-4285-8ffc-b4a37210a3a4" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Deleting offline snapshot bf98d3b1-a056-4285-8ffc-b4a37210a3a4 of volume 57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] snapshot_file for this snap is: volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3538c0-9c4f-4f00-b0c7-36bc2f768831]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:34 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 Jul 21 19:11:34 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:35 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7aa48f-b339-495a-a197-b1863a2a065a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (7d5856c0-f368-417d-b8ce-3420062c9ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:35 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e Jul 21 19:11:35 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a40f297-150c-4dfd-9295-b9ddd6cc29e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a40f297-150c-4dfd-9295-b9ddd6cc29e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1832952609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b0636-2f8d-4c2c-8c14-5056eb6a70e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:35Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9227d-3a69-46c9-bbc6-9465c28aa889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9227d-3a69-46c9-bbc6-9465c28aa889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca176c8-1c3f-494f-8f8f-1bb77412fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca176c8-1c3f-494f-8f8f-1bb77412fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1b0636-2f8d-4c2c-8c14-5056eb6a70e4', 'volume_name': 'volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e61cfb6-a8c5-4a6e-b067-39116dff025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e61cfb6-a8c5-4a6e-b067-39116dff025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9a9a1-18c9-4f38-81de-04d7097b5e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Volume df1b0636-2f8d-4c2c-8c14-5056eb6a70e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4', 'volume_size': 1} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1832952609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1b0636-2f8d-4c2c-8c14-5056eb6a70e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:35Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Creating volume df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:35 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 1073741824 Jul 21 19:11:35 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:35 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:35 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 Jul 21 19:11:35 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:36 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 1073741824" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:36 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 Jul 21 19:11:36 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:36 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4" returned: 0 in 0.568s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:36 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4 Jul 21 19:11:36 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:36 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:36 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e.bf98d3b1-a056-4285-8ffc-b4a37210a3a4" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9a9a1-18c9-4f38-81de-04d7097b5e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b4fa34-8021-4a5d-b2b1-3af1cb7339a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-bf98d3b1-a056-4285-8ffc-b4a37210a3a4" released by "_delete_snapshot" :: held 2.127s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Volume volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 (df1b0636-2f8d-4c2c-8c14-5056eb6a70e4): created successfully Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b4fa34-8021-4a5d-b2b1-3af1cb7339a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (7d5856c0-f368-417d-b8ce-3420062c9ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" released by "delete_snapshot" :: held 2.197s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-804345f6-3ba6-4627-904c-1f6c13ea8e48 tempest-AttachVolumeTestJSON-1274736618 None] Created volume successfully. Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-d770b4e8-9379-4e7b-b70f-1030ba4a98e2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-d770b4e8-9379-4e7b-b70f-1030ba4a98e2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Deleting offline snapshot d770b4e8-9379-4e7b-b70f-1030ba4a98e2 of volume a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] snapshot_file for this snap is: volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0944e4-d3d1-4edd-bfed-251643b8c929]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:36 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 Jul 21 19:11:36 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:37 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7514d10-16c5-4c7f-bdab-f3abfb730736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd91dada-7526-487d-8e3b-78f1ecef779e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:37 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 Jul 21 19:11:37 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:37 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:37 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 Jul 21 19:11:37 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-953bbdb6-6856-44e1-9eb6-f8953848d51f req-8686e222-a72d-4164-a1cb-74f1eb91057a tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-953bbdb6-6856-44e1-9eb6-f8953848d51f req-8686e222-a72d-4164-a1cb-74f1eb91057a tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-953bbdb6-6856-44e1-9eb6-f8953848d51f req-8686e222-a72d-4164-a1cb-74f1eb91057a tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:38 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-953bbdb6-6856-44e1-9eb6-f8953848d51f req-8686e222-a72d-4164-a1cb-74f1eb91057a tempest-AttachVolumeTestJSON-1274736618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d8ba3e4-b309-4ad9-8c23-e884f820e455', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:38 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2 Jul 21 19:11:38 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-953bbdb6-6856-44e1-9eb6-f8953848d51f req-8686e222-a72d-4164-a1cb-74f1eb91057a tempest-AttachVolumeTestJSON-1274736618 None] attachment_update completed successfully. Jul 21 19:11:38 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736.d770b4e8-9379-4e7b-b70f-1030ba4a98e2" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-d770b4e8-9379-4e7b-b70f-1030ba4a98e2" released by "_delete_snapshot" :: held 1.792s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" released by "delete_snapshot" :: held 1.829s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:38 devstack cinder-volume[87498]: WARNING cinder.quota [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2030973624 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2030973624, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:38 devstack cinder-volume[87498]: WARNING cinder.quota [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2030973624 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2030973624, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['70555278-e71a-4dcd-8f87-9d1920148abc', 'e9979ae9-535c-4624-b27c-c00d1660d589', '8ba7d3ec-c6c1-4e6a-a0e0-65226815e2dc', '68f4988c-0548-4b8f-9cf5-53f3624590ef'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['324b17cd-f650-4f02-9373-0fcec45d44ba', 'd84a4e5b-e77f-4900-9b3e-84c0c8ffd55b', '538f6daa-b94c-429d-87b2-d42d771799e7', 'dc81bceb-627b-4443-98d4-56eb61da0486'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b765835d-8e07-4bb5-b8ae-e62f6a511a42 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 7c2b31f3-eb4e-40b0-8906-5e3ca928c08d: deleted successfully Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1838f9d4-ad51-4bd3-86cf-83d14e851b09]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:39 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e Jul 21 19:11:39 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (270a70dd-c3bb-4587-8fa0-eeaa8c299f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387afab9-acfd-4fb4-a348-46825bb90e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387afab9-acfd-4fb4-a348-46825bb90e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095684759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3de60b-45db-41c3-92ed-e8343a3e6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:40Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21411c4-4169-4d4b-8b4c-7621fe70a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21411c4-4169-4d4b-8b4c-7621fe70a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d403f7-4065-4d84-b303-5f27a2a8d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d403f7-4065-4d84-b303-5f27a2a8d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe3de60b-45db-41c3-92ed-e8343a3e6c92', 'volume_name': 'volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da050b65-2fae-40a1-ac63-3ea0eab1607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da050b65-2fae-40a1-ac63-3ea0eab1607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b296ad-a8ad-4c5f-8ebf-f3b7fe87346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Volume fe3de60b-45db-41c3-92ed-e8343a3e6c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92', 'volume_size': 1} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095684759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3de60b-45db-41c3-92ed-e8343a3e6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115b18f90975465a861680d5483b94f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:40Z,use_quota=True,user_id='7d2be1dc5c054ac9ac0a98127e5279a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Creating volume fe3de60b-45db-41c3-92ed-e8343a3e6c92 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 1073741824 Jul 21 19:11:40 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:40 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e Jul 21 19:11:40 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:40 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:40 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 1073741824" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-57e06d3f-0f9b-429b-ad94-aa64cfcf9a1e" released by "delete_volume" :: held 0.808s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88624a30-02d6-4a95-b0ae-db643f9b0984]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 Jul 21 19:11:40 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:40 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 Jul 21 19:11:40 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:40 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b296ad-a8ad-4c5f-8ebf-f3b7fe87346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efe2130-ce69-4d72-aa2c-3486be8144f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Volume volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 (fe3de60b-45db-41c3-92ed-e8343a3e6c92): created successfully Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efe2130-ce69-4d72-aa2c-3486be8144f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Flow 'volume_create_manager' (270a70dd-c3bb-4587-8fa0-eeaa8c299f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e824989c-ea37-41d5-a381-69f18004539c tempest-AttachVolumeTestJSON-1274736618 None] Created volume successfully. Jul 21 19:11:40 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:40 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736 Jul 21 19:11:40 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:41 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7514d10-16c5-4c7f-bdab-f3abfb730736" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a7514d10-16c5-4c7f-bdab-f3abfb730736" released by "delete_volume" :: held 0.712s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['c27c4b0d-b9cd-4c93-9335-017615b4e962'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:41 devstack cinder-volume[87498]: WARNING cinder.quota [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2030973624 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2030973624, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['902e1a8f-42e9-472f-8974-ba612acdb50d', 'd6def9c5-ca23-413a-9593-d347e2b3d1eb', 'dc29cf06-06b6-4f1d-a6a5-319c6852be26', '76104cea-1c8e-4177-963b-c62e80e65776'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['2861fd3d-7933-4df7-8772-73c6bf078502', 'a75932a9-e66c-47d7-8978-bf1aeb2be18a', '8b706a47-7d3d-4d11-a4df-8477704fb94a', 'e4431265-d5cc-4912-b942-df9894c9e523'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:41 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:41 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:41 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3dc1c611-208e-4060-9eed-776b26d55a0f tempest-GroupSnapshotsTest-1455482519 None] Delete group completed successfully. Jul 21 19:11:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28c67ca8-bfcb-42c5-a058-048857b10eb7 tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-685551416: creating Jul 21 19:11:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28c67ca8-bfcb-42c5-a058-048857b10eb7 tempest-GroupSnapshotsTest-1455482519 None] Group tempest-GroupSnapshotsTest-Group-685551416: created successfully Jul 21 19:11:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28c67ca8-bfcb-42c5-a058-048857b10eb7 tempest-GroupSnapshotsTest-1455482519 None] Create group completed successfully. Jul 21 19:11:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-3cfcaa28-89f5-41e6-b79d-c01f85300f4a req-6ea53a4f-e510-4a3b-860a-6f9db979c642 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-3cfcaa28-89f5-41e6-b79d-c01f85300f4a req-6ea53a4f-e510-4a3b-860a-6f9db979c642 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-3cfcaa28-89f5-41e6-b79d-c01f85300f4a req-6ea53a4f-e510-4a3b-860a-6f9db979c642 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-3cfcaa28-89f5-41e6-b79d-c01f85300f4a req-6ea53a4f-e510-4a3b-860a-6f9db979c642 tempest-AttachVolumeTestJSON-1274736618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98227de1-55ee-434b-913f-cdd6d1252204', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-3cfcaa28-89f5-41e6-b79d-c01f85300f4a req-6ea53a4f-e510-4a3b-860a-6f9db979c642 tempest-AttachVolumeTestJSON-1274736618 None] attachment_update completed successfully. Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (cd59be62-9e13-4ade-b787-940f3799b5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73657315-57cf-482f-994a-1943eb91b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73657315-57cf-482f-994a-1943eb91b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38124816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c3aec6a-96e3-4845-96c1-75caef4fb135,host='devstack@QuobyteHD#QuobyteHD',id=a0ead85b-4d71-4969-82cb-5b0951e31494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:44Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4698dbf2-3c20-49ed-a34e-8cbe3c6d8c36),volume_type_id=4698dbf2-3c20-49ed-a34e-8cbe3c6d8c36)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0748e969-e76f-425d-b753-54fbd40c21d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0748e969-e76f-425d-b753-54fbd40c21d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e346495f-e32a-4565-8bdf-e8d2d6eda26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e346495f-e32a-4565-8bdf-e8d2d6eda26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ead85b-4d71-4969-82cb-5b0951e31494', 'volume_name': 'volume-a0ead85b-4d71-4969-82cb-5b0951e31494', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffce0be-2a73-450b-b0c0-8f148e7bc63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffce0be-2a73-450b-b0c0-8f148e7bc63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32518e8e-2049-44c7-919b-7d903cbc8823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Volume a0ead85b-4d71-4969-82cb-5b0951e31494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ead85b-4d71-4969-82cb-5b0951e31494', 'volume_size': 1} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c3aec6a-96e3-4845-96c1-75caef4fb135,created_at=2026-07-21T17:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38124816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c3aec6a-96e3-4845-96c1-75caef4fb135,host='devstack@QuobyteHD#QuobyteHD',id=a0ead85b-4d71-4969-82cb-5b0951e31494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be866f8519410a9ecd4bded7816673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:44Z,use_quota=True,user_id='14b786e242914d45a4097ad12513de3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4698dbf2-3c20-49ed-a34e-8cbe3c6d8c36),volume_type_id=4698dbf2-3c20-49ed-a34e-8cbe3c6d8c36)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Creating volume a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:44 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 1073741824 Jul 21 19:11:44 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-7cca0596-5a23-4771-902d-d7af616913a2 req-c23bc534-6b32-4fcf-a8f6-81425e123a60 tempest-AttachVolumeTestJSON-1274736618 None] Terminate volume connection completed successfully. Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-7cca0596-5a23-4771-902d-d7af616913a2 req-c23bc534-6b32-4fcf-a8f6-81425e123a60 tempest-AttachVolumeTestJSON-1274736618 None] Deleting attachment 5d8ba3e4-b309-4ad9-8c23-e884f820e455. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:44 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 1073741824" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:44 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 Jul 21 19:11:44 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:45 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32518e8e-2049-44c7-919b-7d903cbc8823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ead85b-4d71-4969-82cb-5b0951e31494', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e160f03-c3e0-41ae-8594-c1df6cadc6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Volume volume-a0ead85b-4d71-4969-82cb-5b0951e31494 (a0ead85b-4d71-4969-82cb-5b0951e31494): created successfully Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e160f03-c3e0-41ae-8594-c1df6cadc6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Flow 'volume_create_manager' (cd59be62-9e13-4ade-b787-940f3799b5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-55956aa1-0e9f-45d7-8e85-b4e137ef1839 tempest-GroupSnapshotsTest-1455482519 None] Created volume successfully. Jul 21 19:11:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] GroupSnapshot 1f46fd47-c065-467c-8139-afa7a69c652a: creating. Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Group snapshot 1f46fd47-c065-467c-8139-afa7a69c652a: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Creating offline snapshot b4080a93-af86-44e8-b391-d2fa05827aaf of volume a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9696fc-03d0-4dc0-a050-545e0c8486d3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:45 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 Jul 21 19:11:45 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b9524b31-ad24-41f1-be52-96a356ec65e5 req-aabbd26f-6103-45d4-86d7-c29bde36e1ff tempest-AttachVolumeTestJSON-1274736618 None] Terminate volume connection completed successfully. Jul 21 19:11:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b9524b31-ad24-41f1-be52-96a356ec65e5 req-aabbd26f-6103-45d4-86d7-c29bde36e1ff tempest-AttachVolumeTestJSON-1274736618 None] Deleting attachment 98227de1-55ee-434b-913f-cdd6d1252204. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:46 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf 1G Jul 21 19:11:46 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf 1G" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ead85b-4d71-4969-82cb-5b0951e31494 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ead85b-4d71-4969-82cb-5b0951e31494 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf Jul 21 19:11:46 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:46 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ead85b-4d71-4969-82cb-5b0951e31494 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:46 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf Jul 21 19:11:46 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:47 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:47 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info Jul 21 19:11:47 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:47 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:47 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:11:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:47 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info Jul 21 19:11:47 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:48 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.info" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca95b71a-868f-421b-bbd6-5853912baa0f tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 1f46fd47-c065-467c-8139-afa7a69c652a: created successfully Jul 21 19:11:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-956e8d89-a2bd-434a-842a-674937a935ba req-32bdbaec-5f52-427d-863c-4f3bc6ae08a0 tempest-ServerActionsTestOtherA-962255443 None] Terminate volume connection completed successfully. Jul 21 19:11:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-956e8d89-a2bd-434a-842a-674937a935ba req-32bdbaec-5f52-427d-863c-4f3bc6ae08a0 tempest-ServerActionsTestOtherA-962255443 None] Deleting attachment 7a307196-5783-410d-9b97-369ab1f1a017. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 1f46fd47-c065-467c-8139-afa7a69c652a: deleting Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 1f46fd47-c065-467c-8139-afa7a69c652a: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-b4080a93-af86-44e8-b391-d2fa05827aaf" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-b4080a93-af86-44e8-b391-d2fa05827aaf" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Deleting offline snapshot b4080a93-af86-44e8-b391-d2fa05827aaf of volume a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] snapshot_file for this snap is: volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b286f-074a-499d-821b-e32526875cd1]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:49 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf Jul 21 19:11:49 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:50 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf" returned: 0 in 0.819s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ead85b-4d71-4969-82cb-5b0951e31494(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:11:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7406267-f50c-430e-8b3b-17b70df7aa5b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:50 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 Jul 21 19:11:50 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (dc322f2e-c76e-4cbd-a7de-abea7bb382b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48405c65-380c-4cb4-8e16-724593f8d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48405c65-380c-4cb4-8e16-724593f8d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-25557360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:51Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3990ad-dc66-46e5-b3a7-0652cc9eb580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3990ad-dc66-46e5-b3a7-0652cc9eb580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856eb5a0-2049-40c5-8cf0-f741acbe36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856eb5a0-2049-40c5-8cf0-f741acbe36e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578', 'volume_name': 'volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee24b6e-e121-44ca-9144-153bbb2d048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee24b6e-e121-44ca-9144-153bbb2d048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66289e3c-7654-459d-bd46-b76103cfb48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Volume f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578', 'volume_size': 1} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-25557360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a571cfabe842d68073594088a6228b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:11:51Z,use_quota=True,user_id='6dd141b800234743a935f3c62dee0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Creating volume f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:11:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 1073741824 Jul 21 19:11:51 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf Jul 21 19:11:51 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf Jul 21 19:11:51 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 1073741824" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:51 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 Jul 21 19:11:51 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:51 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494.b4080a93-af86-44e8-b391-d2fa05827aaf" returned: 0 in 0.442s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-b4080a93-af86-44e8-b391-d2fa05827aaf" released by "_delete_snapshot" :: held 2.486s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" released by "delete_snapshot" :: held 2.540s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:52 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66289e3c-7654-459d-bd46-b76103cfb48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c0e7f3-a174-4348-88b7-29747c6c2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:11:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Volume volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 (f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578): created successfully Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c0e7f3-a174-4348-88b7-29747c6c2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Flow 'volume_create_manager' (dc322f2e-c76e-4cbd-a7de-abea7bb382b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:11:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d71925f1-1c13-4806-8854-f33101ab8d85 tempest-AttachVolumeNegativeTest-1762307697 None] Created volume successfully. Jul 21 19:11:52 devstack cinder-volume[87498]: WARNING cinder.quota [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2000069029 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2000069029, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:52 devstack cinder-volume[87498]: WARNING cinder.quota [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2000069029 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2000069029, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['3ef952e8-7a7c-47ba-83ca-c171ddde0e77', '28b7888d-687a-4252-bbbe-5df3fc633f2b', 'a23e30eb-5a83-4a11-bb8a-5d2d10d51058', 'b5d528f1-3e7f-4726-ba17-c5be395acc27'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ad611b8e-160e-477e-80b3-0bee357a17a7 tempest-GroupSnapshotsTest-1455482519 None] group_snapshot 1f46fd47-c065-467c-8139-afa7a69c652a: deleted successfully Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-fe3de60b-45db-41c3-92ed-e8343a3e6c92-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-fe3de60b-45db-41c3-92ed-e8343a3e6c92-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-quobyte-fe3de60b-45db-41c3-92ed-e8343a3e6c92" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-fe3de60b-45db-41c3-92ed-e8343a3e6c92" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed31ba-ad1f-44da-992f-e7bdc3c72335]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 Jul 21 19:11:53 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a035814-dc87-4033-92e6-9075b9be2f62]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 Jul 21 19:11:53 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92" returned: 0 in 0.532s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92 Jul 21 19:11:53 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:53 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494 Jul 21 19:11:53 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:53 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fe3de60b-45db-41c3-92ed-e8343a3e6c92" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-fe3de60b-45db-41c3-92ed-e8343a3e6c92" released by "delete_volume" :: held 0.938s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13c77673-a3db-4ef3-a3af-0a1640080da9 req-7ae6f7f2-0a33-4ae6-a8d2-2dfa5ec7a206 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13c77673-a3db-4ef3-a3af-0a1640080da9 req-7ae6f7f2-0a33-4ae6-a8d2-2dfa5ec7a206 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13c77673-a3db-4ef3-a3af-0a1640080da9 req-7ae6f7f2-0a33-4ae6-a8d2-2dfa5ec7a206 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:54 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a0ead85b-4d71-4969-82cb-5b0951e31494" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Created reservations ['6e9870c1-86ad-48e3-bb3e-54dd26f9b8ae', '5d44526d-7160-438b-ac92-b415a9755107', '3992abd4-9a33-46fe-81f0-a38831d66a74', 'b6a6f1be-3c39-4cff-9526-dd3b18d46560'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Lock "cinder-quobyte-a0ead85b-4d71-4969-82cb-5b0951e31494" released by "delete_volume" :: held 0.915s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-13c77673-a3db-4ef3-a3af-0a1640080da9 req-7ae6f7f2-0a33-4ae6-a8d2-2dfa5ec7a206 tempest-AttachVolumeNegativeTest-1762307697 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9835992-61ce-4c3c-be48-b6f2b9477fed', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:54 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:54 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-13c77673-a3db-4ef3-a3af-0a1640080da9 req-7ae6f7f2-0a33-4ae6-a8d2-2dfa5ec7a206 tempest-AttachVolumeNegativeTest-1762307697 None] attachment_update completed successfully. Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['5a4c8cca-9cd5-4fde-aa1e-f607e9baf6ad'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:54 devstack cinder-volume[87498]: WARNING cinder.quota [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2000069029 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2000069029, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Created reservations ['a9a0760e-a664-4924-a4d7-0cd42e79625e', '83c84e23-b2cf-4966-acc1-e7fef80bf678', '02840808-fd9c-4e64-9d33-944f8f4a630d', '40a97824-4d01-4f2e-8160-f638a9da819b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:54 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Deleted volume successfully. Jul 21 19:11:54 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:54 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cf966a51-cd74-47f1-ac87-716e86f9ed21 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-fe3de60b-45db-41c3-92ed-e8343a3e6c92-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "cinder-296607cc-ad09-4e07-80d6-f65fb3a0d95b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "cinder-296607cc-ad09-4e07-80d6-f65fb3a0d95b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "cinder-quobyte-296607cc-ad09-4e07-80d6-f65fb3a0d95b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "cinder-quobyte-296607cc-ad09-4e07-80d6-f65fb3a0d95b" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388d04b-9209-4f6c-a08d-8db9d28141ab]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-795aaaa8-3652-4551-8d48-c141e6559a98 tempest-GroupSnapshotsTest-1455482519 None] Delete group completed successfully. Jul 21 19:11:55 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b Jul 21 19:11:55 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-quobyte-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf9fd0e-334a-40f2-9f2d-7aa5c026df87]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 Jul 21 19:11:55 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b Jul 21 19:11:55 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4 Jul 21 19:11:55 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:55 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-296607cc-ad09-4e07-80d6-f65fb3a0d95b" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "cinder-quobyte-296607cc-ad09-4e07-80d6-f65fb3a0d95b" released by "delete_volume" :: held 0.850s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Created reservations ['89a0b605-c887-433a-abb9-aea6353f6af1', 'd5546564-6d96-4f96-83e3-d8fc8fd97571', 'f22514fb-adeb-40c8-b303-7a788393962d', 'd11f278d-1d78-4e40-ac52-ba0acbeedd37'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:55 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4" released by "delete_volume" :: held 0.750s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:56 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Created reservations ['be8cc069-323b-4dc9-a141-8c5499da3bdc', '1bc2a095-04cf-4f59-a1ce-cc56e3595996', '940e8ad0-fa9b-4b24-b135-2c0a5bdbe11e', '3dd38aa1-ffcc-4bce-9115-900d6777346c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:56 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:56 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:56 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Deleted volume successfully. Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ce01269-e784-4096-8799-4da5a13485ba tempest-ServerActionsTestOtherA-962255443 None] Lock "cinder-296607cc-ad09-4e07-80d6-f65fb3a0d95b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Deleted volume successfully. Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4193e7e9-d72d-4a8d-822b-a4a78cb7a39f tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-df1b0636-2f8d-4c2c-8c14-5056eb6a70e4-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-b6ced50b-067e-4e85-a76c-1106d3c7b6cc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-b6ced50b-067e-4e85-a76c-1106d3c7b6cc-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "cinder-quobyte-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b6b80c-990d-42a0-8d14-d31230ab975f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc Jul 21 19:11:57 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6512633a-7ffa-43d2-af5c-4f9a8a8129b4 req-257e556b-67db-4656-be35-a8da5209cf8c tempest-AttachVolumeNegativeTest-1762307697 None] Terminate volume connection completed successfully. Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6512633a-7ffa-43d2-af5c-4f9a8a8129b4 req-257e556b-67db-4656-be35-a8da5209cf8c tempest-AttachVolumeNegativeTest-1762307697 None] Deleting attachment f9835992-61ce-4c3c-be48-b6f2b9477fed. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:11:57 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" returned: 0 in 0.625s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:57 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc Jul 21 19:11:57 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:58 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-quobyte-b6ced50b-067e-4e85-a76c-1106d3c7b6cc" released by "delete_volume" :: held 1.079s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Created reservations ['f46965b0-8c0c-4f90-8cb9-8a04cbc04eda', '99045f13-3ea6-4e2c-87bb-5856a9ebce79', '5fb3095f-af79-4caf-b66a-1822eda8511e', '47f5a8a8-3458-4c79-971e-b8b52f931d72'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:11:58 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:11:58 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:11:58 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:11:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Deleted volume successfully. Jul 21 19:11:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c6b9be5-1fad-444c-b86a-2a1d33ea02d8 tempest-AttachVolumeTestJSON-1274736618 None] Lock "cinder-b6ced50b-067e-4e85-a76c-1106d3c7b6cc-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-443361db-1723-470b-a488-b53428775cd7 tempest-GroupsV320Test-926168346 None] Group tempest-GroupsV320Test-Group-109942489: creating Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=144,cinder:INSERT=30,cinder:UPDATE=123,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-443361db-1723-470b-a488-b53428775cd7 tempest-GroupsV320Test-926168346 None] Group tempest-GroupsV320Test-Group-109942489: created successfully Jul 21 19:12:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-443361db-1723-470b-a488-b53428775cd7 tempest-GroupsV320Test-926168346 None] Create group completed successfully. Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-quobyte-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0714929e-f7d8-470a-bada-a13265075f11]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:04 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 Jul 21 19:12:04 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:05 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" returned: 0 in 0.497s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:05 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578 Jul 21 19:12:05 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:05 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578" released by "delete_volume" :: held 1.023s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Created reservations ['0db128e9-68fd-436f-9433-770a7e50cfd3', '97bc2c48-a6d4-44ec-89fc-45754532ad78', '9d101010-4770-45f8-89d0-4c563b4cd719', 'b0b5a7ae-a062-4c8f-a158-c2c3d77d674f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:06 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:06 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=165,cinder:INSERT=32,cinder:UPDATE=150,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:12:06 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Created reservations ['6bddd76f-c321-483e-8179-410794af5d39'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Deleted volume successfully. Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f857dec2-df50-42c1-a52c-8540562299e2 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-f1ed5c6e-10a7-4e9e-abc9-f6f07d72e578-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:06 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:06 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:06 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-27513c74-e24b-4ea5-8500-a5849a13f255 tempest-GroupsV320Test-926168346 None] Delete group completed successfully. Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-6a960313-ad26-4358-a2d0-7b26ffbefef2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-6a960313-ad26-4358-a2d0-7b26ffbefef2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-quobyte-6a960313-ad26-4358-a2d0-7b26ffbefef2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-6a960313-ad26-4358-a2d0-7b26ffbefef2" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21787059-e50f-4a1b-84cb-0e46fdbed99e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:07 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 Jul 21 19:12:07 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:07 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:07 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2 Jul 21 19:12:07 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:08 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a960313-ad26-4358-a2d0-7b26ffbefef2" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-6a960313-ad26-4358-a2d0-7b26ffbefef2" released by "delete_volume" :: held 0.817s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Created reservations ['db3e59ac-8fc6-467a-a53e-aaef77e6220f', '5a7cb491-e647-4135-bd49-db9ff3f33968', 'db6168a7-c914-48b9-9233-12ea92ada9e0', 'b318721e-f4ef-4f39-a186-4c8648b940da'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:08 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:08 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:08 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-f78e1f79-c592-494f-ae39-a3d2654df77b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Deleted volume successfully. Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-f78e1f79-c592-494f-ae39-a3d2654df77b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fcb0a152-2d32-4ec6-a075-6effa3dd8675 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-6a960313-ad26-4358-a2d0-7b26ffbefef2-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "cinder-quobyte-f78e1f79-c592-494f-ae39-a3d2654df77b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-f78e1f79-c592-494f-ae39-a3d2654df77b" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e62ef81-5d8e-4ff5-a135-57752e57dc62]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:08 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b Jul 21 19:12:08 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b Jul 21 19:12:09 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:09 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f78e1f79-c592-494f-ae39-a3d2654df77b" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-quobyte-f78e1f79-c592-494f-ae39-a3d2654df77b" released by "delete_volume" :: held 0.849s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Created reservations ['e90f33a1-7276-417c-a834-dad3b45597d8', 'af55cb1d-dd4a-46fb-9357-c3c65879c214', '49a2fcb9-7e73-4f7e-85a4-16b34a69693c', '14a9c8ac-b489-4f79-a5fc-80385b123cda'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:09 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:09 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:10 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Deleted volume successfully. Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52e1ff10-ca48-497a-99a7-1e6b0e0e45c7 tempest-AttachVolumeNegativeTest-1762307697 None] Lock "cinder-f78e1f79-c592-494f-ae39-a3d2654df77b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Flow 'volume_create_manager' (3bb93006-cae5-4bdd-9a77-d5da2687defd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38cca6-055a-49da-8def-9eade97cf72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38cca6-055a-49da-8def-9eade97cf72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1729472426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e291546a-ef4c-4baf-b13b-ff3c174b670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d34d88b3d0493c861152bc21112423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:11Z,use_quota=True,user_id='c647481ca2734515922cabc35595cf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b13a87-a4fd-4774-8124-bf14d764b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b13a87-a4fd-4774-8124-bf14d764b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c9519-dd79-433c-961e-39b0392e39b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c9519-dd79-433c-961e-39b0392e39b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e291546a-ef4c-4baf-b13b-ff3c174b670d', 'volume_name': 'volume-e291546a-ef4c-4baf-b13b-ff3c174b670d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489d284a-a566-4547-b5d9-3ac814bc530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489d284a-a566-4547-b5d9-3ac814bc530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bace980-3874-4be9-af4c-985062ac2d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Volume e291546a-ef4c-4baf-b13b-ff3c174b670d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e291546a-ef4c-4baf-b13b-ff3c174b670d', 'volume_size': 1} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1729472426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e291546a-ef4c-4baf-b13b-ff3c174b670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d34d88b3d0493c861152bc21112423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:11Z,use_quota=True,user_id='c647481ca2734515922cabc35595cf14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Creating volume e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:10 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d 1073741824 Jul 21 19:12:10 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:11 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d 1073741824" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:11 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d Jul 21 19:12:11 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:11 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bace980-3874-4be9-af4c-985062ac2d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e291546a-ef4c-4baf-b13b-ff3c174b670d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db3910-8c50-4642-a6ac-306a85796065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Volume volume-e291546a-ef4c-4baf-b13b-ff3c174b670d (e291546a-ef4c-4baf-b13b-ff3c174b670d): created successfully Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db3910-8c50-4642-a6ac-306a85796065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Flow 'volume_create_manager' (3bb93006-cae5-4bdd-9a77-d5da2687defd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d5f7c592-ffa5-41cf-ba2b-e40bcc853208 req-dfc7bb2c-8e9d-41a0-9783-8991a9461418 tempest-VolumesSnapshotsTestJSON-162315777 None] Created volume successfully. Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Creating offline snapshot 2dd2d618-e5d4-46c5-b925-347ffd4bca37 of volume e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[89181a50-aec4-4e71-833c-b32e3df88f69]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:13 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d Jul 21 19:12:13 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:13 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d" returned: 0 in 0.687s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:13 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 1G Jul 21 19:12:13 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:14 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 1G" returned: 0 in 0.548s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e291546a-ef4c-4baf-b13b-ff3c174b670d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:14 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e291546a-ef4c-4baf-b13b-ff3c174b670d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 Jul 21 19:12:14 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:14 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e291546a-ef4c-4baf-b13b-ff3c174b670d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:14 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 is being set with open permissions: ugo+rw Jul 21 19:12:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:14 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 Jul 21 19:12:14 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:15 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:15 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info Jul 21 19:12:15 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:15 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:15 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info is being set with open permissions: ugo+rw Jul 21 19:12:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:15 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info Jul 21 19:12:15 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:16 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.info" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.987s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-79a5414d-575d-4a75-a96d-9caee361670a req-a5c315ae-9c5a-46cb-86ab-ce4896e0128d tempest-VolumesSnapshotsTestJSON-162315777 None] Create snapshot completed successfully Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "cinder-2dd2d618-e5d4-46c5-b925-347ffd4bca37-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-2dd2d618-e5d4-46c5-b925-347ffd4bca37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "cinder-quobyte-2dd2d618-e5d4-46c5-b925-347ffd4bca37" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-2dd2d618-e5d4-46c5-b925-347ffd4bca37" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Deleting offline snapshot 2dd2d618-e5d4-46c5-b925-347ffd4bca37 of volume e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] snapshot_file for this snap is: volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08655907-cf8f-41b9-8aed-94f9c55937fa]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:17 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 Jul 21 19:12:17 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:17 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e291546a-ef4c-4baf-b13b-ff3c174b670d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31491a98-048b-4082-8c4f-ed1395a3ad36]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:17 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d Jul 21 19:12:17 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:18 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d" returned: 0 in 0.602s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:18 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 Jul 21 19:12:18 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:18 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:18 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37 Jul 21 19:12:18 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:19 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d.2dd2d618-e5d4-46c5-b925-347ffd4bca37" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-2dd2d618-e5d4-46c5-b925-347ffd4bca37" released by "_delete_snapshot" :: held 2.097s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" released by "delete_snapshot" :: held 2.141s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:19 devstack cinder-volume[87498]: WARNING cinder.quota [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:12:19 devstack cinder-volume[87498]: DEBUG cinder.quota [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Created reservations ['840ada76-f18d-4b81-a11a-879d98454329', 'e5c088b5-95e1-4dc3-b2a3-aab1e154e954', '6c80fa04-b742-4835-b2d1-8159686d88b0', 'cdde7ae5-c62e-4618-872c-7532558ccc91'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Delete snapshot completed successfully. Jul 21 19:12:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-55b58f34-6145-4eed-a11f-c255515edda0 req-cebfa5ff-70cc-4c6a-99d1-f681cf308fb2 tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-2dd2d618-e5d4-46c5-b925-347ffd4bca37-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "cinder-e291546a-ef4c-4baf-b13b-ff3c174b670d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-e291546a-ef4c-4baf-b13b-ff3c174b670d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabe5db-1161-4740-89e6-21c03097df4b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:20 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d Jul 21 19:12:20 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:21 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:21 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d Jul 21 19:12:21 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:21 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e291546a-ef4c-4baf-b13b-ff3c174b670d" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-quobyte-e291546a-ef4c-4baf-b13b-ff3c174b670d" released by "delete_volume" :: held 0.871s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG cinder.quota [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Created reservations ['309036d0-a355-4dfa-8929-917ad6c069c0', '486edb6c-d3fa-426d-9120-6869347a7055', '7b6c9d73-99de-4dce-8a5d-d65eee44d2a6', '8395af71-bd43-4c15-9d54-d8d48edcd741'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:21 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:21 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:22 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:22 devstack cinder-volume[87498]: DEBUG cinder.manager [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Deleted volume successfully. Jul 21 19:12:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-ed57ec67-e9ef-4669-923e-db712a6864cb req-3a546033-3cec-4083-8b34-4a10ef763c3a tempest-VolumesSnapshotsTestJSON-162315777 None] Lock "cinder-e291546a-ef4c-4baf-b13b-ff3c174b670d-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:25 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:25 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:26 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:12:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:12:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:12:30 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Flow 'volume_create_manager' (2f8ee2bb-1878-49d2-96fb-782730406320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c618e896-b17d-43cf-9322-8795e0bfe913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c618e896-b17d-43cf-9322-8795e0bfe913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-804168287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da41aa9-4980-4e70-8743-8214bfc22a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c4dd42ee4c19b94b1cef3477c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:31Z,use_quota=True,user_id='84e9e55df81947eba67ae80874d63ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2947f50-bee9-4beb-8ab9-b829a7bd202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2947f50-bee9-4beb-8ab9-b829a7bd202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8785faca-966b-4882-b2c6-2d5731a2dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8785faca-966b-4882-b2c6-2d5731a2dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da41aa9-4980-4e70-8743-8214bfc22a27', 'volume_name': 'volume-0da41aa9-4980-4e70-8743-8214bfc22a27', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518b1665-7111-4375-914e-aa220c9f8eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518b1665-7111-4375-914e-aa220c9f8eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff56cd2-9a98-4df9-b148-b5d6d18ac1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume 0da41aa9-4980-4e70-8743-8214bfc22a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da41aa9-4980-4e70-8743-8214bfc22a27', 'volume_size': 1} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-804168287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da41aa9-4980-4e70-8743-8214bfc22a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c4dd42ee4c19b94b1cef3477c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:31Z,use_quota=True,user_id='84e9e55df81947eba67ae80874d63ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Creating volume 0da41aa9-4980-4e70-8743-8214bfc22a27 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 1073741824 Jul 21 19:12:31 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:31 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 1073741824" returned: 0 in 0.709s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:31 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 Jul 21 19:12:31 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:32 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff56cd2-9a98-4df9-b148-b5d6d18ac1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da41aa9-4980-4e70-8743-8214bfc22a27', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b6f04a-0853-47fe-ac2f-d52b6047f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume volume-0da41aa9-4980-4e70-8743-8214bfc22a27 (0da41aa9-4980-4e70-8743-8214bfc22a27): created successfully Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b6f04a-0853-47fe-ac2f-d52b6047f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Flow 'volume_create_manager' (2f8ee2bb-1878-49d2-96fb-782730406320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-80854714-f7f5-4809-b3bf-dc532552a5c5 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Created volume successfully. Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "cinder-0da41aa9-4980-4e70-8743-8214bfc22a27-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "cinder-0da41aa9-4980-4e70-8743-8214bfc22a27-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "cinder-quobyte-0da41aa9-4980-4e70-8743-8214bfc22a27" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "cinder-quobyte-0da41aa9-4980-4e70-8743-8214bfc22a27" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268387e-79e7-4d89-8ead-8e9b0aa91228]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:33 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 Jul 21 19:12:33 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:33 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:33 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27 Jul 21 19:12:33 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0da41aa9-4980-4e70-8743-8214bfc22a27" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "cinder-quobyte-0da41aa9-4980-4e70-8743-8214bfc22a27" released by "delete_volume" :: held 0.883s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Created reservations ['81a13e0c-7674-4448-b9a0-1ae03e943ba3', 'd3234d20-2afd-44a9-a739-4ce167cc6c16', '1cc3df3b-029a-4979-98bd-fa5bbaaedcec', 'df22ab04-3e57-4ab5-bccc-c4318daed3da'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:34 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:34 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:34 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.562s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Deleted volume successfully. Jul 21 19:12:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0892c548-69a8-44f4-99f8-28844e161f02 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "cinder-0da41aa9-4980-4e70-8743-8214bfc22a27-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Flow 'volume_create_manager' (885b23e4-5d99-406b-ad37-364eaa9d5b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92c2d63-21ee-4afc-841d-572e20d1c541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92c2d63-21ee-4afc-841d-572e20d1c541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-259646413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad4f50a-a5fd-4bd6-bb48-522d55098df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c4dd42ee4c19b94b1cef3477c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:37Z,use_quota=True,user_id='84e9e55df81947eba67ae80874d63ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b914e3f5-f98a-4385-b77a-0ccd001695a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b914e3f5-f98a-4385-b77a-0ccd001695a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ed2f7-76d6-4a94-813e-4439062ceb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353ed2f7-76d6-4a94-813e-4439062ceb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad4f50a-a5fd-4bd6-bb48-522d55098df1', 'volume_name': 'volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb8279-b58f-4ffc-9df4-067317d7a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb8279-b58f-4ffc-9df4-067317d7a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1818cb-c30e-4d89-b660-81783d7e8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume 7ad4f50a-a5fd-4bd6-bb48-522d55098df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1', 'volume_size': 1} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-259646413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad4f50a-a5fd-4bd6-bb48-522d55098df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c4dd42ee4c19b94b1cef3477c6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:37Z,use_quota=True,user_id='84e9e55df81947eba67ae80874d63ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Creating volume 7ad4f50a-a5fd-4bd6-bb48-522d55098df1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:37 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 1073741824 Jul 21 19:12:37 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:38 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 1073741824" returned: 0 in 1.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:38 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 Jul 21 19:12:38 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:39 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" returned: 0 in 0.763s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1818cb-c30e-4d89-b660-81783d7e8518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9085a909-f01f-45ae-b910-8fa7239cd4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Volume volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 (7ad4f50a-a5fd-4bd6-bb48-522d55098df1): created successfully Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9085a909-f01f-45ae-b910-8fa7239cd4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Flow 'volume_create_manager' (885b23e4-5d99-406b-ad37-364eaa9d5b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9579c3c9-9ad4-47a0-9141-e00d224a7553 tempest-VolumeQuotasAdminTestJSON-1806036711 None] Created volume successfully. Jul 21 19:12:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a275283-316f-4af7-bfeb-ea3b3ee3ff56 tempest-GroupSnapshotsV319Test-1619097370 None] Group tempest-GroupSnapshotsV319Test-Group-510605644: creating Jul 21 19:12:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a275283-316f-4af7-bfeb-ea3b3ee3ff56 tempest-GroupSnapshotsV319Test-1619097370 None] Group tempest-GroupSnapshotsV319Test-Group-510605644: created successfully Jul 21 19:12:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a275283-316f-4af7-bfeb-ea3b3ee3ff56 tempest-GroupSnapshotsV319Test-1619097370 None] Create group completed successfully. Jul 21 19:12:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a932a1ec-1bd9-49b2-8ee4-c723b3ced8e6 tempest-VolumeQuotasAdminTestJSON-650364666 None] Transfer volume completed successfully. Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Acquiring lock "cinder-7ad4f50a-a5fd-4bd6-bb48-522d55098df1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "cinder-7ad4f50a-a5fd-4bd6-bb48-522d55098df1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Acquiring lock "cinder-quobyte-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "cinder-quobyte-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32da33d-146b-45dd-ae0d-2a4b932ac136]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:42 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 Jul 21 19:12:42 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:43 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" returned: 0 in 0.682s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:43 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1 Jul 21 19:12:43 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:44 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Flow 'volume_create_manager' (346e9877-b23e-462a-9794-8b8eb4a1de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5578e7e3-c726-4ff9-892d-9137da233654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5578e7e3-c726-4ff9-892d-9137da233654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560262315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaad4ae7-fbd2-4b3d-ba15-b9b90fb1b4ed,host='devstack@QuobyteHD#QuobyteHD',id=a7dfeba5-0fca-4755-ab87-c25bcc0fc48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a736cbea70547dcb59ba16d1bd45a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:44Z,use_quota=True,user_id='871ddad39f324a89bfdb37c89d1f4315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf19d7d0-b194-40d4-8b0e-40466ed33eb1),volume_type_id=cf19d7d0-b194-40d4-8b0e-40466ed33eb1)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c45466-9c82-4c42-bfa4-c05ac06f310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c45466-9c82-4c42-bfa4-c05ac06f310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838a1bf3-3308-4e01-86a7-eb413c4e92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838a1bf3-3308-4e01-86a7-eb413c4e92df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dfeba5-0fca-4755-ab87-c25bcc0fc48d', 'volume_name': 'volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173b40d7-a94c-49c4-ac71-69c4516786c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173b40d7-a94c-49c4-ac71-69c4516786c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa9749-cdba-456d-914d-9cbb729ea97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Volume a7dfeba5-0fca-4755-ab87-c25bcc0fc48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d', 'volume_size': 1} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eaad4ae7-fbd2-4b3d-ba15-b9b90fb1b4ed,created_at=2026-07-21T17:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560262315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaad4ae7-fbd2-4b3d-ba15-b9b90fb1b4ed,host='devstack@QuobyteHD#QuobyteHD',id=a7dfeba5-0fca-4755-ab87-c25bcc0fc48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a736cbea70547dcb59ba16d1bd45a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:44Z,use_quota=True,user_id='871ddad39f324a89bfdb37c89d1f4315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf19d7d0-b194-40d4-8b0e-40466ed33eb1),volume_type_id=cf19d7d0-b194-40d4-8b0e-40466ed33eb1)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Creating volume a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "cinder-quobyte-7ad4f50a-a5fd-4bd6-bb48-522d55098df1" released by "delete_volume" :: held 1.502s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:44 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d 1073741824 Jul 21 19:12:44 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Created reservations ['04610690-9a85-4736-9e41-7a10f39f2f09', '33880037-cb4b-459d-8b24-88da19d1ac64', '28dd096a-a376-4549-9eda-7cb2b8bc80ac', 'a2f2ab39-f0d3-4dd2-b175-924c0e3b1d3a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:44 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:44 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:45 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.653s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Deleted volume successfully. Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feacd63d-68c2-49ba-ba1f-9670a31dd657 tempest-VolumeQuotasAdminTestJSON-364188113 None] Lock "cinder-7ad4f50a-a5fd-4bd6-bb48-522d55098df1-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:45 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d 1073741824" returned: 0 in 1.167s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:45 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d Jul 21 19:12:45 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:45 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fa9749-cdba-456d-914d-9cbb729ea97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f27cf-0318-4065-b551-523dc5ce8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Volume volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d (a7dfeba5-0fca-4755-ab87-c25bcc0fc48d): created successfully Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f27cf-0318-4065-b551-523dc5ce8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Flow 'volume_create_manager' (346e9877-b23e-462a-9794-8b8eb4a1de10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-757b6ebd-3724-463b-b8fb-c6e5b3792ec4 tempest-GroupSnapshotsV319Test-1619097370 None] Created volume successfully. Jul 21 19:12:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] GroupSnapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: creating. Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Group snapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Creating offline snapshot 5752e64a-13e6-42b3-ab1c-683e39450395 of volume a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b7fa3-7d47-4d54-b419-82f24195e989]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Flow 'volume_create_manager' (d924d5ba-292c-4fa4-94f4-bdb5a56a1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5485d391-320a-4c97-a378-ed0ced7fdb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5485d391-320a-4c97-a378-ed0ced7fdb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-270936683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7533bb-730c-4727-b952-221e27fc3e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='671f3a0c20df4478bc96e2ce51fcc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:48Z,use_quota=True,user_id='89596411cd2e40f98f0b4e533931e2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a56481e-a717-43d9-b2e8-f23b4c4a1149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a56481e-a717-43d9-b2e8-f23b4c4a1149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028f836-fa97-424d-962a-4372d5fe9fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028f836-fa97-424d-962a-4372d5fe9fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7533bb-730c-4727-b952-221e27fc3e3f', 'volume_name': 'volume-be7533bb-730c-4727-b952-221e27fc3e3f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848017dd-b710-41de-9094-a6554973c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848017dd-b710-41de-9094-a6554973c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea196cf-450c-4050-948c-822e197d1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Volume be7533bb-730c-4727-b952-221e27fc3e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7533bb-730c-4727-b952-221e27fc3e3f', 'volume_size': 1} Jul 21 19:12:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:47 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d Jul 21 19:12:47 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" returned: 0 in 0.650s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:48 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 1G Jul 21 19:12:48 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:48 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 1G" returned: 0 in 0.713s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:48 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 Jul 21 19:12:48 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:49 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395" returned: 0 in 0.696s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:12:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:49 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 Jul 21 19:12:49 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info Jul 21 19:12:50 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:50 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info" returned: 0 in 0.476s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:50 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:12:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:50 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info Jul 21 19:12:50 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:51 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.info" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-270936683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7533bb-730c-4727-b952-221e27fc3e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='671f3a0c20df4478bc96e2ce51fcc46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:48Z,use_quota=True,user_id='89596411cd2e40f98f0b4e533931e2dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Creating volume be7533bb-730c-4727-b952-221e27fc3e3f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:51 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f 1073741824 Jul 21 19:12:51 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cfc573a0-78af-4c0f-9667-38b4cdcef5bf tempest-GroupSnapshotsV319Test-1619097370 None] group_snapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: created successfully Jul 21 19:12:52 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f 1073741824" returned: 0 in 1.126s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:52 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f Jul 21 19:12:52 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] group_snapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: deleting Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] group_snapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "cinder-quobyte-5752e64a-13e6-42b3-ab1c-683e39450395" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-5752e64a-13e6-42b3-ab1c-683e39450395" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Deleting offline snapshot 5752e64a-13e6-42b3-ab1c-683e39450395 of volume a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] snapshot_file for this snap is: volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1f832-c19f-4cb3-b37f-27ec62c7b97c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:53 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f" returned: 0 in 0.945s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea196cf-450c-4050-948c-822e197d1704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7533bb-730c-4727-b952-221e27fc3e3f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062799b6-73d5-4f73-9460-477c8c727218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Volume volume-be7533bb-730c-4727-b952-221e27fc3e3f (be7533bb-730c-4727-b952-221e27fc3e3f): created successfully Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062799b6-73d5-4f73-9460-477c8c727218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Flow 'volume_create_manager' (d924d5ba-292c-4fa4-94f4-bdb5a56a1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3c3abc5e-6c56-4814-97b6-3166939aba05 tempest-ServerRescueNegativeTestJSON-593995879 None] Created volume successfully. Jul 21 19:12:53 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 Jul 21 19:12:53 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:53 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395" returned: 0 in 0.613s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d72f6e1-0b2f-4dbf-8d2f-2effdd911209]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d Jul 21 19:12:54 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:54 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" returned: 0 in 0.637s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:54 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 Jul 21 19:12:54 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:55 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395" returned: 0 in 0.736s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:55 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395 Jul 21 19:12:55 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:56 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Flow 'volume_create_manager' (6178d1ef-7c8e-4319-a9f8-138d761b55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98099aef-2837-4e33-bae7-837e6ce4aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d.5752e64a-13e6-42b3-ab1c-683e39450395" returned: 0 in 0.783s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-5752e64a-13e6-42b3-ab1c-683e39450395" released by "_delete_snapshot" :: held 2.943s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98099aef-2837-4e33-bae7-837e6ce4aed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-31466781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991fbb26-e89e-4edd-af62-d54303dcb443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071e1ddeaecd4e90b5369fccc8efc6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:56Z,use_quota=True,user_id='529390e7491b41679f94dccd67c71b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fe4c1b6-de18-4394-ab1f-e93798342900),volume_type_id=0fe4c1b6-de18-4394-ab1f-e93798342900)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e4a835-6c45-4e75-86bb-ba85d61d41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e4a835-6c45-4e75-86bb-ba85d61d41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33d4681-41f1-408c-8164-cf15f117cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33d4681-41f1-408c-8164-cf15f117cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991fbb26-e89e-4edd-af62-d54303dcb443', 'volume_name': 'volume-991fbb26-e89e-4edd-af62-d54303dcb443', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09cba84-7267-4f69-a868-9488be4dd652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09cba84-7267-4f69-a868-9488be4dd652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a75c3f5-717e-43fc-a146-e9da11ff5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Volume 991fbb26-e89e-4edd-af62-d54303dcb443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991fbb26-e89e-4edd-af62-d54303dcb443', 'volume_size': 1} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-31466781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991fbb26-e89e-4edd-af62-d54303dcb443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071e1ddeaecd4e90b5369fccc8efc6c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:12:56Z,use_quota=True,user_id='529390e7491b41679f94dccd67c71b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fe4c1b6-de18-4394-ab1f-e93798342900),volume_type_id=0fe4c1b6-de18-4394-ab1f-e93798342900)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Creating volume 991fbb26-e89e-4edd-af62-d54303dcb443 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:12:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" released by "delete_snapshot" :: held 3.033s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:56 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 1073741824 Jul 21 19:12:56 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:56 devstack cinder-volume[87498]: WARNING cinder.quota [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1481108224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1481108224, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:12:56 devstack cinder-volume[87498]: WARNING cinder.quota [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1481108224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1481108224, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:12:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] Created reservations ['b8b922c3-4c9f-4989-a3da-df10e4eccae4', 'b85431d0-d8c5-4024-9b13-d9345bf16a3f', '473567cb-7c1a-4ce7-a48c-fd4c88f3a55c', 'a15d9972-562b-4c5c-bcbd-8dee0f927cdf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d78fb8c6-d7b2-41b2-8689-75a3d98c283a tempest-GroupSnapshotsV319Test-1619097370 None] group_snapshot 8484e79b-edb0-47d3-95be-333d2dd7be95: deleted successfully Jul 21 19:12:57 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 1073741824" returned: 0 in 0.918s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 Jul 21 19:12:57 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3fa34d-9964-49bb-852a-fc6f5a9817c2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:57 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d Jul 21 19:12:57 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:57 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a75c3f5-717e-43fc-a146-e9da11ff5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991fbb26-e89e-4edd-af62-d54303dcb443', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8a896-a18b-482d-8c62-642ee8edf737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:12:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Volume volume-991fbb26-e89e-4edd-af62-d54303dcb443 (991fbb26-e89e-4edd-af62-d54303dcb443): created successfully Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc8a896-a18b-482d-8c62-642ee8edf737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:12:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Flow 'volume_create_manager' (6178d1ef-7c8e-4319-a9f8-138d761b55d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:12:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2d79fa7a-21aa-4cc1-9596-5eef45068de9 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Created volume successfully. Jul 21 19:12:58 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" returned: 0 in 0.625s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:58 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d Jul 21 19:12:58 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:58 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Lock "cinder-quobyte-a7dfeba5-0fca-4755-ab87-c25bcc0fc48d" released by "delete_volume" :: held 1.163s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Created reservations ['ff85e204-c162-4f59-b698-abc3908e102e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:58 devstack cinder-volume[87498]: WARNING cinder.quota [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1481108224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1481108224, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Created reservations ['a101b7bb-d08e-48b2-84cf-44a25ab74b48', 'c40bbcfe-37d4-4299-932e-28fc8e51f38f', '9f55a8ba-c1c4-412d-8d70-4b95c9d4ce51', '6059ef2f-91d7-4c6e-ba06-495fe2975302'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:12:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:12:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:12:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:12:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:12:59 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:12:59 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:12:59 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 21 19:12:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:12:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:12:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d6672dc2-4b24-4a58-85b0-bcb7b2d16aba tempest-GroupSnapshotsV319Test-1619097370 None] Delete group completed successfully. Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:00 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:00 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:00 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba5e8dc0-16e0-4788-8f3d-21dcb3ac5de5 tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Retype volume completed successfully. Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Flow 'volume_create_manager' (1c4fce74-bca2-4a64-99a0-3bb1d4fb0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b333937d-a048-4c8b-b958-641b121ee7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b333937d-a048-4c8b-b958-641b121ee7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-136050656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9198f9b5-8756-446c-9cf9-8457cadc6cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac2b1c22efe4fb285dd7b8d0a447b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:01Z,use_quota=True,user_id='4886473a7d1341f8ae1010a1ceee1894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2093656d-5392-4873-98ae-5f203ef2aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2093656d-5392-4873-98ae-5f203ef2aef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89274635-99f5-4ce2-b05d-2d0ddd5adcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89274635-99f5-4ce2-b05d-2d0ddd5adcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9198f9b5-8756-446c-9cf9-8457cadc6cc3', 'volume_name': 'volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da344dd4-178b-4c16-991b-860fa5a20d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da344dd4-178b-4c16-991b-860fa5a20d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d93fcb0-d483-4c20-a444-b91de6b365fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Volume 9198f9b5-8756-446c-9cf9-8457cadc6cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3', 'volume_size': 1} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-136050656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9198f9b5-8756-446c-9cf9-8457cadc6cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac2b1c22efe4fb285dd7b8d0a447b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:01Z,use_quota=True,user_id='4886473a7d1341f8ae1010a1ceee1894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Creating volume 9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:01 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 1073741824 Jul 21 19:13:01 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "cinder-991fbb26-e89e-4edd-af62-d54303dcb443-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "cinder-991fbb26-e89e-4edd-af62-d54303dcb443-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "cinder-quobyte-991fbb26-e89e-4edd-af62-d54303dcb443" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "cinder-quobyte-991fbb26-e89e-4edd-af62-d54303dcb443" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b3761-5f9b-40c4-b1f0-09c998afb911]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 1073741824" returned: 0 in 0.734s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:01 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 Jul 21 19:13:01 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:01 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 Jul 21 19:13:01 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d93fcb0-d483-4c20-a444-b91de6b365fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90065756-778f-4010-977a-d8dc2df63010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:02 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443" returned: 0 in 0.613s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443 Jul 21 19:13:02 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Volume volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 (9198f9b5-8756-446c-9cf9-8457cadc6cc3): created successfully Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90065756-778f-4010-977a-d8dc2df63010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Flow 'volume_create_manager' (1c4fce74-bca2-4a64-99a0-3bb1d4fb0854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-056836d7-6913-462c-aa6a-4dc0e54ffd83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Created volume successfully. Jul 21 19:13:02 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-991fbb26-e89e-4edd-af62-d54303dcb443" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "cinder-quobyte-991fbb26-e89e-4edd-af62-d54303dcb443" released by "delete_volume" :: held 0.978s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:02 devstack cinder-volume[87498]: WARNING cinder.quota [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:02 devstack cinder-volume[87498]: WARNING cinder.quota [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Created reservations ['d0b181a7-4e40-4115-ae95-a3fb4a162dfc', 'a9b80bcf-6b07-401d-9933-531e3ef9d03e', '5d1bce49-2fc0-4c38-b2d7-500bd6479c44', 'be9be079-d718-4c6c-af85-132aa6234324'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:02 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:02 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:03 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Deleted volume successfully. Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-802bb05a-fc30-4c1a-8e9c-5bc1b7cf28fa tempest-VolumeRetypeWithoutMigrationTest-1494591621 None] Lock "cinder-991fbb26-e89e-4edd-af62-d54303dcb443-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Acquiring lock "cinder-be7533bb-730c-4727-b952-221e27fc3e3f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "cinder-be7533bb-730c-4727-b952-221e27fc3e3f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Acquiring lock "cinder-quobyte-be7533bb-730c-4727-b952-221e27fc3e3f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Creating offline snapshot cd30df62-5201-4419-a266-7297ab62d026 of volume 9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "cinder-quobyte-be7533bb-730c-4727-b952-221e27fc3e3f" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04092897-71e5-4cc7-91f4-d98a7ee5b8af]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7894a6c-91d6-4bbe-a3c1-eba8ccf1c630]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 Jul 21 19:13:04 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:04 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f Jul 21 19:13:04 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:04 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3" returned: 0 in 0.625s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 1G Jul 21 19:13:04 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:04 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f" returned: 0 in 0.718s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:04 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f Jul 21 19:13:04 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:05 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-be7533bb-730c-4727-b952-221e27fc3e3f" returned: 0 in 0.653s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:05 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 1G" returned: 0 in 0.787s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "cinder-quobyte-be7533bb-730c-4727-b952-221e27fc3e3f" released by "delete_volume" :: held 1.463s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=120,cinder:SELECT=101,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:05 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 Jul 21 19:13:05 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Created reservations ['7504bcf6-af9f-47b3-8ac4-bfa8b20f1662', 'e3b6d1dc-99de-47d1-92a0-53550ad571f7', '967c60f9-38ee-49ff-8bcf-83dbc013fcef', '9d18902b-25ad-4988-b896-d620d2ca6d38'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:05 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:05 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:05 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 is being set with open permissions: ugo+rw Jul 21 19:13:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:06 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 Jul 21 19:13:06 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:06 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Deleted volume successfully. Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b633576-6e96-42ba-820a-fdcc546f202e tempest-ServerRescueNegativeTestJSON-593995879 None] Lock "cinder-be7533bb-730c-4727-b952-221e27fc3e3f-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:06 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026" returned: 0 in 0.495s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=90,cinder:UPDATE=104,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:13:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:06 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info Jul 21 19:13:06 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:07 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info" returned: 0 in 0.591s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:07 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info is being set with open permissions: ugo+rw Jul 21 19:13:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:07 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info Jul 21 19:13:07 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:07 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.info" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.851s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f6c7fe1a-63b6-44dd-9441-d0108b95cc26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Create snapshot completed successfully Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "cinder-cd30df62-5201-4419-a266-7297ab62d026-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-cd30df62-5201-4419-a266-7297ab62d026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "cinder-quobyte-cd30df62-5201-4419-a266-7297ab62d026" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-cd30df62-5201-4419-a266-7297ab62d026" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Deleting offline snapshot cd30df62-5201-4419-a266-7297ab62d026 of volume 9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] snapshot_file for this snap is: volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2630da97-eb80-41f3-bbdb-73f32614466f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:09 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 Jul 21 19:13:09 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:10 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026" returned: 0 in 0.703s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453d6e6-7cb9-42ce-949d-dcb4a662612f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:10 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 Jul 21 19:13:10 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:10 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:10 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 Jul 21 19:13:10 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:11 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:11 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026 Jul 21 19:13:11 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:11 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3.cd30df62-5201-4419-a266-7297ab62d026" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-cd30df62-5201-4419-a266-7297ab62d026" released by "_delete_snapshot" :: held 2.435s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" released by "delete_snapshot" :: held 2.475s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Created reservations ['d40e6f5d-9c09-4d58-bcf4-14e98097a451', '19409c37-eabc-400b-9bc8-dd815780a854', 'cb5367cb-8496-4ccb-ad46-8235a9e222d8', 'dc29d7bb-19dc-4f64-8e64-fc1f94739690'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Delete snapshot completed successfully. Jul 21 19:13:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ea2b480a-eba2-4cc6-8256-25a902bd8d02 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-cd30df62-5201-4419-a266-7297ab62d026-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "cinder-9198f9b5-8756-446c-9cf9-8457cadc6cc3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-9198f9b5-8756-446c-9cf9-8457cadc6cc3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4bd084-8d18-4a78-9d99-8ab0853f31af]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:12 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 Jul 21 19:13:12 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:13 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:13 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3 Jul 21 19:13:13 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:13 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9198f9b5-8756-446c-9cf9-8457cadc6cc3" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-quobyte-9198f9b5-8756-446c-9cf9-8457cadc6cc3" released by "delete_volume" :: held 0.824s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Created reservations ['0395ca6a-bd8c-4ba0-86e7-76bd7c0e119c', '1b7fdf88-50c3-4468-8959-efe14f376141', 'bdbb2111-1c26-45fa-af99-80ebd21b7d38', '1af564f9-d6bb-4f99-bd90-0c8e8ab2104e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:13 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:13 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:14 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Deleted volume successfully. Jul 21 19:13:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1df2d53-07d0-45ca-ab64-1a397c43a563 tempest-VolumeSnapshotQuotasNegativeTestJSON-1039550041 None] Lock "cinder-9198f9b5-8756-446c-9cf9-8457cadc6cc3-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d0c126e-0178-4dd7-87aa-bab3b00e636d tempest-GroupsTest-99239013 None] Group tempest-Group1-1929324139: creating Jul 21 19:13:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d0c126e-0178-4dd7-87aa-bab3b00e636d tempest-GroupsTest-99239013 None] Group tempest-Group1-1929324139: created successfully Jul 21 19:13:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d0c126e-0178-4dd7-87aa-bab3b00e636d tempest-GroupsTest-99239013 None] Create group completed successfully. Jul 21 19:13:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7e285d8-5083-4cc0-9ae3-400651cd621f tempest-GroupsTest-99239013 None] Group tempest-Group2-458960094: creating Jul 21 19:13:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7e285d8-5083-4cc0-9ae3-400651cd621f tempest-GroupsTest-99239013 None] Group tempest-Group2-458960094: created successfully Jul 21 19:13:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7e285d8-5083-4cc0-9ae3-400651cd621f tempest-GroupsTest-99239013 None] Create group completed successfully. Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (e63628e7-d05a-4abe-8221-6a3c81e4a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b17d59e-dec3-4f23-9a69-a4c5984c128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b17d59e-dec3-4f23-9a69-a4c5984c128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991131923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3260c00e-0ae9-47ff-b150-7923c4a7280c,host='devstack@QuobyteHD#QuobyteHD',id=4ac54211-4833-4e6f-a692-9009a098bb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:22Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178b5448-c251-41a8-9a16-d36bfa9ee787),volume_type_id=178b5448-c251-41a8-9a16-d36bfa9ee787)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28172d16-ba08-410c-a3d2-75d63f04350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28172d16-ba08-410c-a3d2-75d63f04350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d1705f-9b58-4605-a096-68d7730bd4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d1705f-9b58-4605-a096-68d7730bd4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac54211-4833-4e6f-a692-9009a098bb48', 'volume_name': 'volume-4ac54211-4833-4e6f-a692-9009a098bb48', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f674c09-c757-4a61-808f-8fc11f2bf47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f674c09-c757-4a61-808f-8fc11f2bf47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262e0a4-a093-4aeb-89df-a12d37fdb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Volume 4ac54211-4833-4e6f-a692-9009a098bb48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac54211-4833-4e6f-a692-9009a098bb48', 'volume_size': 1} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3260c00e-0ae9-47ff-b150-7923c4a7280c,created_at=2026-07-21T17:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991131923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3260c00e-0ae9-47ff-b150-7923c4a7280c,host='devstack@QuobyteHD#QuobyteHD',id=4ac54211-4833-4e6f-a692-9009a098bb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:22Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178b5448-c251-41a8-9a16-d36bfa9ee787),volume_type_id=178b5448-c251-41a8-9a16-d36bfa9ee787)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Creating volume 4ac54211-4833-4e6f-a692-9009a098bb48 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:22 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 1073741824 Jul 21 19:13:22 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:22 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 1073741824" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:22 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 Jul 21 19:13:22 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:23 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a262e0a4-a093-4aeb-89df-a12d37fdb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac54211-4833-4e6f-a692-9009a098bb48', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d947d9-a4da-452e-a445-a1742e5e6799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Volume volume-4ac54211-4833-4e6f-a692-9009a098bb48 (4ac54211-4833-4e6f-a692-9009a098bb48): created successfully Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d947d9-a4da-452e-a445-a1742e5e6799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (e63628e7-d05a-4abe-8221-6a3c81e4a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1c346e5d-099d-422e-a120-f3839511cf01 tempest-GroupsTest-99239013 None] Created volume successfully. Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf45a86-fc21-4bd9-a8bc-014aa563efb2 tempest-BackendsCapabilitiesAdminTestsJSON-1146447633 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7378044128418, 'free_capacity_gb': 1775.7378044128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:13:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d88731ca-588c-49e0-bd5d-730dae1823b6 tempest-BackendsCapabilitiesAdminTestsJSON-1146447633 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7378044128418, 'free_capacity_gb': 1775.7378044128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Flow 'volume_create_manager' (00ad3212-1e56-4de1-8929-c3fdd97dce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672625a7-48a6-4923-a320-8fd2bba24c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672625a7-48a6-4923-a320-8fd2bba24c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1423093813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3020b7-e33a-42d1-990b-8a2bab02d19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128d5ebafb044e3b9e92c52c0917fa76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:24Z,use_quota=True,user_id='6fb79c9369764d85b655cfbdbd78e229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ca5e309-e232-472f-a1c1-b1ea9978048e),volume_type_id=7ca5e309-e232-472f-a1c1-b1ea9978048e)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd25cfa7-05b9-4af9-801e-46b14cc78064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd25cfa7-05b9-4af9-801e-46b14cc78064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb2a2d-94cf-4dc1-8317-df97a32b238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb2a2d-94cf-4dc1-8317-df97a32b238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3020b7-e33a-42d1-990b-8a2bab02d19d', 'volume_name': 'volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea5410-ba79-4bd2-ab18-c88d7b07438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea5410-ba79-4bd2-ab18-c88d7b07438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adb85d1-2e01-4860-bb00-bab6c100efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Volume ac3020b7-e33a-42d1-990b-8a2bab02d19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d', 'volume_size': 1} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1423093813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3020b7-e33a-42d1-990b-8a2bab02d19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='128d5ebafb044e3b9e92c52c0917fa76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:24Z,use_quota=True,user_id='6fb79c9369764d85b655cfbdbd78e229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ca5e309-e232-472f-a1c1-b1ea9978048e),volume_type_id=7ca5e309-e232-472f-a1c1-b1ea9978048e)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Creating volume ac3020b7-e33a-42d1-990b-8a2bab02d19d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d 1073741824 Jul 21 19:13:24 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Acquiring lock "cinder-quobyte-4ac54211-4833-4e6f-a692-9009a098bb48" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-4ac54211-4833-4e6f-a692-9009a098bb48" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b0694-d940-4392-b171-2ec9ec806e9f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 Jul 21 19:13:24 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:24 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d 1073741824" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:24 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:24 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48 Jul 21 19:13:24 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:24 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d Jul 21 19:13:24 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:25 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ac54211-4833-4e6f-a692-9009a098bb48" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-4ac54211-4833-4e6f-a692-9009a098bb48" released by "delete_volume" :: held 0.895s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:25 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adb85d1-2e01-4860-bb00-bab6c100efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb3e985-39e4-44e7-98dd-d21b62914730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Volume volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d (ac3020b7-e33a-42d1-990b-8a2bab02d19d): created successfully Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb3e985-39e4-44e7-98dd-d21b62914730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Flow 'volume_create_manager' (00ad3212-1e56-4de1-8929-c3fdd97dce03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f64c494-ee74-4832-8feb-a7efd60379f0 tempest-VolumeTypesAccessTest-1510931203 None] Created volume successfully. Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Created reservations ['ee423936-d084-4b01-b9a1-7b0379f35552'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:25 devstack cinder-volume[87498]: WARNING cinder.quota [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1184126524 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1184126524, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:25 devstack cinder-volume[87498]: WARNING cinder.quota [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1184126524 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1184126524, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Created reservations ['d958e328-e49e-474b-92ac-edd973202cee', '416aac68-f1be-4a9b-a8ca-db7903627965', '29740d6c-62f3-4e53-8257-14cc220f0578', '96f4a1ac-c11b-4011-b750-77faab3a413f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:25 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:25 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Created reservations ['85671c4c-7c97-4ae6-b1cb-adc2fec62911'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:25 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:25 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:25 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f9338256-1b64-4454-b9e5-24ed1eaeb727 tempest-GroupsTest-99239013 None] Delete group completed successfully. Jul 21 19:13:25 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:25 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:26 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:13:26 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fe5e6010-857c-4dfd-82ce-f1fcd3311c55 tempest-GroupsTest-99239013 None] Delete group completed successfully. Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Acquiring lock "cinder-ac3020b7-e33a-42d1-990b-8a2bab02d19d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "cinder-ac3020b7-e33a-42d1-990b-8a2bab02d19d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Acquiring lock "cinder-quobyte-ac3020b7-e33a-42d1-990b-8a2bab02d19d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "cinder-quobyte-ac3020b7-e33a-42d1-990b-8a2bab02d19d" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67d9b5-58c6-4d95-bf40-f6a609da3a56]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:26 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d Jul 21 19:13:26 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:26 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d" returned: 0 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:27 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d Jul 21 19:13:27 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:27 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-ac3020b7-e33a-42d1-990b-8a2bab02d19d" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "cinder-quobyte-ac3020b7-e33a-42d1-990b-8a2bab02d19d" released by "delete_volume" :: held 0.944s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:27 devstack cinder-volume[87498]: WARNING cinder.quota [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2043060066 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2043060066, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:27 devstack cinder-volume[87498]: WARNING cinder.quota [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2043060066 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2043060066, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Created reservations ['e1da0cec-2696-43e6-918a-e6a7d7884c2b', '420b841d-7cf4-4674-a6a1-5d005f6daa14', '749eb963-819f-4f6f-9ea7-d892fbe393a6', 'a18691d7-2f7c-4315-9d01-0c45a796b165'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e77bdf81-e470-4ab0-968d-a494d9e73fde tempest-GroupsTest-99239013 None] Group tempest-GroupsTest-Group-970607693: creating Jul 21 19:13:27 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:27 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e77bdf81-e470-4ab0-968d-a494d9e73fde tempest-GroupsTest-99239013 None] Group tempest-GroupsTest-Group-970607693: created successfully Jul 21 19:13:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e77bdf81-e470-4ab0-968d-a494d9e73fde tempest-GroupsTest-99239013 None] Create group completed successfully. Jul 21 19:13:27 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Deleted volume successfully. Jul 21 19:13:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dc5a8954-0d15-47d3-b5d1-b19254d2cfc5 tempest-VolumeTypesAccessTest-1510931203 None] Lock "cinder-ac3020b7-e33a-42d1-990b-8a2bab02d19d-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (0f0f10be-8c6c-41f5-91f2-b1b84b9d4b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1aa2aaf-1090-4044-bc52-fbe25c856fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1aa2aaf-1090-4044-bc52-fbe25c856fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,host='devstack@QuobyteHD#QuobyteHD',id=371d087a-d5e5-42c2-bad7-ff7e82b3a3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:30Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edae1ab0-d2fd-4aef-9e8a-daa5df1daafb),volume_type_id=edae1ab0-d2fd-4aef-9e8a-daa5df1daafb)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9107e38a-2193-4242-bca8-52b3a3779b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9107e38a-2193-4242-bca8-52b3a3779b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d12e5c2-66f3-4473-8e7a-cf6375af89b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d12e5c2-66f3-4473-8e7a-cf6375af89b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371d087a-d5e5-42c2-bad7-ff7e82b3a3aa', 'volume_name': 'volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050158fc-9b77-4f18-9a1a-2789268cda0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050158fc-9b77-4f18-9a1a-2789268cda0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae3cad-4085-45ac-84dd-4fa0bc4f107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Volume 371d087a-d5e5-42c2-bad7-ff7e82b3a3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa', 'volume_size': 1} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,created_at=2026-07-21T17:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,host='devstack@QuobyteHD#QuobyteHD',id=371d087a-d5e5-42c2-bad7-ff7e82b3a3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:30Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edae1ab0-d2fd-4aef-9e8a-daa5df1daafb),volume_type_id=edae1ab0-d2fd-4aef-9e8a-daa5df1daafb)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Creating volume 371d087a-d5e5-42c2-bad7-ff7e82b3a3aa {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:29 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa 1073741824 Jul 21 19:13:29 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:30 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa 1073741824" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:30 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa Jul 21 19:13:30 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:30 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dae3cad-4085-45ac-84dd-4fa0bc4f107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d0c519-e836-46ec-814c-3aa9fcf97836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Volume volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa (371d087a-d5e5-42c2-bad7-ff7e82b3a3aa): created successfully Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d0c519-e836-46ec-814c-3aa9fcf97836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (0f0f10be-8c6c-41f5-91f2-b1b84b9d4b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aaffbb45-7184-4bae-b1d4-69a31c2f6c7e tempest-GroupsTest-99239013 None] Created volume successfully. Jul 21 19:13:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (a1d8415b-014c-4723-b1e1-06b59f91fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd7314c-74e2-4189-b3f0-50d5c9fedc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd7314c-74e2-4189-b3f0-50d5c9fedc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014683873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,host='devstack@QuobyteHD#QuobyteHD',id=c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:32Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edae1ab0-d2fd-4aef-9e8a-daa5df1daafb),volume_type_id=edae1ab0-d2fd-4aef-9e8a-daa5df1daafb)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b57bf89-437f-4e6c-a04d-74ccbb87d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b57bf89-437f-4e6c-a04d-74ccbb87d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5447c-cc6e-4f3d-baf4-9a9a0b8e0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5447c-cc6e-4f3d-baf4-9a9a0b8e0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023', 'volume_name': 'volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ded5c9a-bbf6-4e81-b8cf-90d53df451bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ded5c9a-bbf6-4e81-b8cf-90d53df451bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427cd61-f74e-4bc4-9a3a-f0f59d05a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Volume c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023', 'volume_size': 1} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014683873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b7ae774-91cb-463a-bab4-1b4eae45dac5,host='devstack@QuobyteHD#QuobyteHD',id=c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2783f2d69fb544019aeabb48f4e4b35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:32Z,use_quota=True,user_id='699e9a9a5ed24b7ab54ed5ae0d4ec7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edae1ab0-d2fd-4aef-9e8a-daa5df1daafb),volume_type_id=edae1ab0-d2fd-4aef-9e8a-daa5df1daafb)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Creating volume c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:32 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 1073741824 Jul 21 19:13:32 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Flow 'volume_create_manager' (65625605-c376-43b8-9377-22e48a7a0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9604ee5-790a-408e-8445-73dd596a18b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4f95556-5f00-4443-a3e2-624c12e89660 tempest-GroupsV314Test-626707702 None] Group tempest-GroupsV314Test-Group-2056988478: creating Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9604ee5-790a-408e-8445-73dd596a18b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1793902829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f91925-f4e2-4a8b-a592-5206b0acefff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2cc5a2140c4d33aba36ec4e983a4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:32Z,use_quota=True,user_id='ab3a73751a994d3d871ee5718c697a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ac1e3c-8d8b-403a-88c8-726247e5627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ac1e3c-8d8b-403a-88c8-726247e5627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98d10d-04e8-4e9e-bd16-b38d5933b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98d10d-04e8-4e9e-bd16-b38d5933b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f91925-f4e2-4a8b-a592-5206b0acefff', 'volume_name': 'volume-c4f91925-f4e2-4a8b-a592-5206b0acefff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a89874-4989-48aa-8e2c-396682e14793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a89874-4989-48aa-8e2c-396682e14793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76dfec1-8b04-442d-8a74-b6ddb84658c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Volume c4f91925-f4e2-4a8b-a592-5206b0acefff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f91925-f4e2-4a8b-a592-5206b0acefff', 'volume_size': 1} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4f95556-5f00-4443-a3e2-624c12e89660 tempest-GroupsV314Test-626707702 None] Group tempest-GroupsV314Test-Group-2056988478: created successfully Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4f95556-5f00-4443-a3e2-624c12e89660 tempest-GroupsV314Test-626707702 None] Create group completed successfully. Jul 21 19:13:32 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 1073741824" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:32 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 Jul 21 19:13:32 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1793902829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f91925-f4e2-4a8b-a592-5206b0acefff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2cc5a2140c4d33aba36ec4e983a4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:32Z,use_quota=True,user_id='ab3a73751a994d3d871ee5718c697a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Creating volume c4f91925-f4e2-4a8b-a592-5206b0acefff {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427cd61-f74e-4bc4-9a3a-f0f59d05a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b318f7e-ee20-474d-b16a-03432116b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:32 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff 1073741824 Jul 21 19:13:32 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Volume volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 (c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023): created successfully Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b318f7e-ee20-474d-b16a-03432116b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Flow 'volume_create_manager' (a1d8415b-014c-4723-b1e1-06b59f91fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8c2fed1c-c31a-4567-9693-4f96a50df7fc tempest-GroupsTest-99239013 None] Created volume successfully. Jul 21 19:13:33 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff 1073741824" returned: 0 in 0.516s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:33 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff Jul 21 19:13:33 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:33 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76dfec1-8b04-442d-8a74-b6ddb84658c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f91925-f4e2-4a8b-a592-5206b0acefff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325075e-f8ad-496e-bf08-327e85c73c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Volume volume-c4f91925-f4e2-4a8b-a592-5206b0acefff (c4f91925-f4e2-4a8b-a592-5206b0acefff): created successfully Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325075e-f8ad-496e-bf08-327e85c73c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Flow 'volume_create_manager' (65625605-c376-43b8-9377-22e48a7a0878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e30157a4-5560-44ec-b11f-a90008b5a85c tempest-AbsoluteLimitsTests-481702657 None] Created volume successfully. Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Flow 'volume_create_manager' (50bc1e3c-be3e-4a4b-b64b-5b9ea51995a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6579b39b-0107-4727-98a1-3fa1ce7b2a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6579b39b-0107-4727-98a1-3fa1ce7b2a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017967746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b6f9234-bdff-486f-9826-601bc66975a1,host='devstack@QuobyteHD#QuobyteHD',id=b9166ccc-893a-4795-b586-d4ef1c6126c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606c9c4b458440c689db0d123c2d5538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:34Z,use_quota=True,user_id='ca188ab88c154de294981ae6825b6516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b980bdef-481e-454c-beb7-494a15b6b91c),volume_type_id=b980bdef-481e-454c-beb7-494a15b6b91c)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5090614a-9c4a-438b-9db6-92d2f2ba923a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5090614a-9c4a-438b-9db6-92d2f2ba923a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a5d75-4bfe-4109-a21e-15cf74b0b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a5d75-4bfe-4109-a21e-15cf74b0b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9166ccc-893a-4795-b586-d4ef1c6126c6', 'volume_name': 'volume-b9166ccc-893a-4795-b586-d4ef1c6126c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953690d-c2c2-4267-bb5e-47add02b83c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953690d-c2c2-4267-bb5e-47add02b83c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e1bee-fbe7-429d-8c5b-51d431d1b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Volume b9166ccc-893a-4795-b586-d4ef1c6126c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9166ccc-893a-4795-b586-d4ef1c6126c6', 'volume_size': 1} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b6f9234-bdff-486f-9826-601bc66975a1,created_at=2026-07-21T17:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1017967746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b6f9234-bdff-486f-9826-601bc66975a1,host='devstack@QuobyteHD#QuobyteHD',id=b9166ccc-893a-4795-b586-d4ef1c6126c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606c9c4b458440c689db0d123c2d5538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:34Z,use_quota=True,user_id='ca188ab88c154de294981ae6825b6516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b980bdef-481e-454c-beb7-494a15b6b91c),volume_type_id=b980bdef-481e-454c-beb7-494a15b6b91c)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Creating volume b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:34 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 1073741824 Jul 21 19:13:34 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a433c31-bfb3-49ff-8aa3-949016c61cdc tempest-GroupsTest-99239013 None] Update group completed successfully. Jul 21 19:13:34 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 1073741824" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:34 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:34 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:34 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e1bee-fbe7-429d-8c5b-51d431d1b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9166ccc-893a-4795-b586-d4ef1c6126c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f8869d-7490-437c-a36a-96d95c36e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Volume volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 (b9166ccc-893a-4795-b586-d4ef1c6126c6): created successfully Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f8869d-7490-437c-a36a-96d95c36e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Flow 'volume_create_manager' (50bc1e3c-be3e-4a4b-b64b-5b9ea51995a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9dac97ef-912a-4e54-9580-a05db70a8b4f tempest-GroupsV314Test-626707702 None] Created volume successfully. Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Acquiring lock "cinder-c4f91925-f4e2-4a8b-a592-5206b0acefff-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "cinder-c4f91925-f4e2-4a8b-a592-5206b0acefff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Acquiring lock "cinder-quobyte-c4f91925-f4e2-4a8b-a592-5206b0acefff" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "cinder-quobyte-c4f91925-f4e2-4a8b-a592-5206b0acefff" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d393e-ea0f-43ae-a28e-ebc1ed74fe86]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:35 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff Jul 21 19:13:35 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e5a0dc9-42fd-4fe1-aa27-a4a121d134db tempest-GroupsTest-99239013 None] Update group completed successfully. Jul 21 19:13:35 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:35 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff Jul 21 19:13:35 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Cloning volume b9166ccc-893a-4795-b586-d4ef1c6126c6 to volume c026c64f-da56-41e4-8902-5040db0bb7f0 Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Creating offline snapshot a58db2ff-8cfd-4a18-b785-b0319778034d of volume b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e49187d-39b1-4cfb-a995-3de586d42e38]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:36 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4f91925-f4e2-4a8b-a592-5206b0acefff" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "cinder-quobyte-c4f91925-f4e2-4a8b-a592-5206b0acefff" released by "delete_volume" :: held 0.927s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:36 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:36 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Created reservations ['d99e8ae3-5b35-451d-a049-5dc2971a8995', 'bb5b69f8-7deb-49e1-bbb4-01903fef7192', '5bf5135c-c5d9-451a-bb5d-090f965328fd', 'cb1ed927-93af-4e6f-802c-3d5a7b093ba8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:36 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:36 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.538s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:36 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d 1G Jul 21 19:13:36 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:36 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Deleted volume successfully. Jul 21 19:13:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f05776a6-8608-41a9-bfff-0be1fe901ede tempest-AbsoluteLimitsTests-481702657 None] Lock "cinder-c4f91925-f4e2-4a8b-a592-5206b0acefff-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:37 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d 1G" returned: 0 in 0.501s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:37 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Acquiring lock "cinder-quobyte-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:37 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbdac42-30af-4989-9a8b-419809b2f339]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:37 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:37 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa Jul 21 19:13:37 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:37 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:37 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info Jul 21 19:13:37 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa Jul 21 19:13:38 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info Jul 21 19:13:38 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-371d087a-d5e5-42c2-bad7-ff7e82b3a3aa" released by "delete_volume" :: held 0.893s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Acquiring lock "cinder-quobyte-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1a1557-380d-419e-9d80-543e18c89152]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.info" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 Jul 21 19:13:38 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Acquiring lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] snapshot: a58db2ff-8cfd-4a18-b785-b0319778034d, volume: c026c64f-da56-41e4-8902-5040db0bb7f0, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02b940-9d32-4af6-b3f5-44f3d2c17a4b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:38 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:38 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:38 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023 Jul 21 19:13:38 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:39 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9166ccc-893a-4795-b586-d4ef1c6126c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[191aafdb-00d9-4b7b-8461-0177349c3945]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:39 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:39 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:39 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "cinder-quobyte-c8d7b74e-e6c4-4ebf-aca0-11fbaab9a023" released by "delete_volume" :: held 0.967s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Created reservations ['aeaba025-ceae-4ccc-947c-1b4cbd58ef1d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:39 devstack cinder-volume[87498]: WARNING cinder.quota [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1267468291 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1267468291, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:39 devstack cinder-volume[87498]: WARNING cinder.quota [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1267468291 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1267468291, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Created reservations ['3547aa01-a382-4c84-b391-e50908da4ef9', 'db766ecb-c95e-4e65-a358-6fd52d47fe3d', '39b572a9-a5cc-4bd2-a291-cd1a5d69763f', 'b792cc71-5c37-4b2d-a633-d0ff93c68fc2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:39 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:39 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 Jul 21 19:13:39 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Created reservations ['e6be5427-fe86-456c-80c6-d1516acc3b3c', 'f7ae9399-300c-4289-8ace-0f0b2985fde8', '337eafdb-55c8-4b06-b2d9-e3a6b963aa43', '8e47f8e4-c9c3-4b4d-a7b8-9c277fbc396d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:39 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:39 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:40 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-747ade76-63d2-49fe-9f68-4ee905b1c084 tempest-GroupsTest-99239013 None] Delete group completed successfully. Jul 21 19:13:45 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0" returned: 0 in 6.110s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735cc60-79fd-41ec-a03b-cd5e7d179434]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:45 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:45 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:46 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.816s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:13:46 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Converted 1024.00 MB image at 167.57 MB/s Jul 21 19:13:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:46 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 Jul 21 19:13:46 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:46 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" released by "_copy_volume_from_snapshot" :: held 8.334s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (d09e3539-48b6-43e1-a1f4-688b3c3aba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf03fc3-93f7-4088-882c-84d22a43a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Acquiring lock "cinder-quobyte-a58db2ff-8cfd-4a18-b785-b0319778034d" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf03fc3-93f7-4088-882c-84d22a43a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1494774842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abbe892-dc4c-45ef-8483-ed97999817d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff5358edef4811b74073f48578f54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:47Z,use_quota=True,user_id='1c603a2330b54b5eb1e1a67c0098f8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326ab2d1-6594-4845-9a4c-49bcf73f98c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326ab2d1-6594-4845-9a4c-49bcf73f98c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab154aad-df18-4b45-b684-f68dd07831c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab154aad-df18-4b45-b684-f68dd07831c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abbe892-dc4c-45ef-8483-ed97999817d2', 'volume_name': 'volume-1abbe892-dc4c-45ef-8483-ed97999817d2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47dd4be-58a3-48c8-943b-7d54302bc858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47dd4be-58a3-48c8-943b-7d54302bc858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181c62da-e295-4f17-99a3-c59acbb089a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Volume 1abbe892-dc4c-45ef-8483-ed97999817d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abbe892-dc4c-45ef-8483-ed97999817d2', 'volume_size': 1} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-a58db2ff-8cfd-4a18-b785-b0319778034d" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Deleting offline snapshot a58db2ff-8cfd-4a18-b785-b0319778034d of volume b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] snapshot_file for this snap is: volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1f8cba-38d0-427b-9dab-af9628d09b15]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:47 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:47 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Flow 'volume_create_manager' (489a1944-3ecc-43c8-b588-95e8464d1c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddf71fb-7c1a-4565-8a51-519f602e0e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddf71fb-7c1a-4565-8a51-519f602e0e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2005909100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbadd4b3-52a4-4c42-816f-668a8150e262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50dfdb2ab22421a9dbea6b39b967d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:47Z,use_quota=True,user_id='246d43c336684c1ba847c068d1a0cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd1fa83-ef95-4c30-889b-54b7bfe85fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd1fa83-ef95-4c30-889b-54b7bfe85fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d265c-01ce-455a-806a-dc0e4232a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97d265c-01ce-455a-806a-dc0e4232a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbadd4b3-52a4-4c42-816f-668a8150e262', 'volume_name': 'volume-cbadd4b3-52a4-4c42-816f-668a8150e262', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881dde70-7216-40d7-a813-769779cc09af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881dde70-7216-40d7-a813-769779cc09af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f639b1-47f3-49e3-92f7-1b67f2d5d78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Volume cbadd4b3-52a4-4c42-816f-668a8150e262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbadd4b3-52a4-4c42-816f-668a8150e262', 'volume_size': 1} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:47 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9166ccc-893a-4795-b586-d4ef1c6126c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a959d088-a1ef-4d5e-b241-225fb0016c7e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:47 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:47 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:47 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:47 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:47 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:48 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:48 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d Jul 21 19:13:48 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:48 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6.a58db2ff-8cfd-4a18-b785-b0319778034d" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-a58db2ff-8cfd-4a18-b785-b0319778034d" released by "_delete_snapshot" :: held 1.541s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.578s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1494774842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abbe892-dc4c-45ef-8483-ed97999817d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff5358edef4811b74073f48578f54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:47Z,use_quota=True,user_id='1c603a2330b54b5eb1e1a67c0098f8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Creating volume 1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:48 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 1073741824 Jul 21 19:13:48 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce4cd8b1-2e26-40ad-9bda-8caeb4ca43e8 tempest-GroupsV314Test-626707702 None] Create group from source-group-9b6f9234-bdff-486f-9826-601bc66975a1 completed successfully. Jul 21 19:13:49 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 1073741824" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:49 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:13:49 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Flow 'volume_create_manager' (9be3cb3c-6265-453e-aa2c-971ec70af54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b038b33d-af70-4ad1-a982-1f4ce62d21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b038b33d-af70-4ad1-a982-1f4ce62d21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1807429498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9ed45f-22d9-43ea-886e-ce81a5f2a98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1881870d50994721bd75adc2e67d7b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:49Z,use_quota=True,user_id='179acefa19234af1881e3b5aa7bfe4d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d2705c-ede8-47e6-9698-5046b1a85691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d2705c-ede8-47e6-9698-5046b1a85691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6be1f0-41d5-4417-a3c7-2c93677e6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6be1f0-41d5-4417-a3c7-2c93677e6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9ed45f-22d9-43ea-886e-ce81a5f2a98a', 'volume_name': 'volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3e7bef-322a-4422-bbcb-cf102fca91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3e7bef-322a-4422-bbcb-cf102fca91d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc193912-cc03-4d96-a7e2-0082e589bf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a', 'volume_size': 1} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2005909100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbadd4b3-52a4-4c42-816f-668a8150e262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50dfdb2ab22421a9dbea6b39b967d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:47Z,use_quota=True,user_id='246d43c336684c1ba847c068d1a0cced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Creating volume cbadd4b3-52a4-4c42-816f-668a8150e262 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181c62da-e295-4f17-99a3-c59acbb089a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abbe892-dc4c-45ef-8483-ed97999817d2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f04a69b-f2f6-4fa7-849d-055f3dd7df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:49 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 1073741824 Jul 21 19:13:49 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Volume volume-1abbe892-dc4c-45ef-8483-ed97999817d2 (1abbe892-dc4c-45ef-8483-ed97999817d2): created successfully Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f04a69b-f2f6-4fa7-849d-055f3dd7df49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (d09e3539-48b6-43e1-a1f4-688b3c3aba51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7439def7-a28c-42c7-a730-965b0001b723 tempest-VolumesDeleteCascade-508861973 None] Created volume successfully. Jul 21 19:13:49 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 1073741824" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:49 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 Jul 21 19:13:49 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Acquiring lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7accf02d-6aa1-4d95-832b-1a62a0dfccf0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1807429498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9ed45f-22d9-43ea-886e-ce81a5f2a98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1881870d50994721bd75adc2e67d7b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:13:49Z,use_quota=True,user_id='179acefa19234af1881e3b5aa7bfe4d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Creating volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:13:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 Jul 21 19:13:50 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a 1073741824 Jul 21 19:13:50 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f639b1-47f3-49e3-92f7-1b67f2d5d78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbadd4b3-52a4-4c42-816f-668a8150e262', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a15ef7f-acdc-4ede-be15-e863bd362d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Volume volume-cbadd4b3-52a4-4c42-816f-668a8150e262 (cbadd4b3-52a4-4c42-816f-668a8150e262): created successfully Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a15ef7f-acdc-4ede-be15-e863bd362d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Flow 'volume_create_manager' (489a1944-3ecc-43c8-b588-95e8464d1c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a87800cc-da4f-44a4-9e04-da5fd94bf29b tempest-VolumesNegativeTest-266505622 None] Created volume successfully. Jul 21 19:13:50 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0 Jul 21 19:13:50 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a 1073741824" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:50 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a Jul 21 19:13:50 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:50 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c026c64f-da56-41e4-8902-5040db0bb7f0" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-c026c64f-da56-41e4-8902-5040db0bb7f0" released by "delete_volume" :: held 0.775s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Created reservations ['ab501160-558a-466c-9f95-e1057484be3a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:50 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1365021926 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1365021926, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:50 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1365021926 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1365021926, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Created reservations ['3cd19653-f816-4d32-ab58-1682a146d95e', '8394d456-3e07-458c-9ed8-1e682e02f2d0', '2eddcbe7-300c-4026-8ec9-3ed9676cacdf', '5f20d10d-8009-4a75-ab1b-218c0dd83b72'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:50 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:51 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:51 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Creating offline snapshot 6b0d0064-3715-4931-82a9-dcd140b446cd of volume 1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc193912-cc03-4d96-a7e2-0082e589bf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31d35df-9787-4b66-84c1-0a7b6872314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e2a48-f197-44a9-9929-e2b09accd7a3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Volume volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a (7d9ed45f-22d9-43ea-886e-ce81a5f2a98a): created successfully Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31d35df-9787-4b66-84c1-0a7b6872314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Flow 'volume_create_manager' (9be3cb3c-6265-453e-aa2c-971ec70af54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:13:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-189bf22c-f965-4363-ab56-d38dfc04a182 tempest-SnapshotsActionsTest-238544476 None] Created volume successfully. Jul 21 19:13:51 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:13:51 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:51 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2fa03d35-8222-4443-907b-61790018a632 tempest-GroupsV314Test-626707702 None] Delete group completed successfully. Jul 21 19:13:51 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.513s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Acquiring lock "cinder-quobyte-b9166ccc-893a-4795-b586-d4ef1c6126c6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-b9166ccc-893a-4795-b586-d4ef1c6126c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:13:51 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd 1G Jul 21 19:13:51 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eef00f-5514-4e24-97a7-292fd348cb58]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:51 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:51 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd 1G" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:52 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.463s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:52 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:13:52 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6 Jul 21 19:13:52 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b9166ccc-893a-4795-b586-d4ef1c6126c6" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Lock "cinder-quobyte-b9166ccc-893a-4795-b586-d4ef1c6126c6" released by "delete_volume" :: held 0.951s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd is being set with open permissions: ugo+rw Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:52 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:13:52 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Created reservations ['f2f22d69-a315-420a-a847-1a287a74c4a4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Created reservations ['f0202072-20f7-47db-aa58-8cc725ffccf8', 'eaf8ca71-471e-4053-851c-55daed2dbab4', '47eed054-add2-47e6-bba1-e674e6798761', 'de611090-a483-491a-a56f-97dc42f5f600'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:13:52 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:53 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info Jul 21 19:13:53 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:53 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:13:53 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:53 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:13:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3fce4bdd-81d6-4358-b399-a1d98f0e60fe tempest-GroupsV314Test-626707702 None] Delete group completed successfully. Jul 21 19:13:53 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info is being set with open permissions: ugo+rw Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:53 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info Jul 21 19:13:53 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:53 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.info" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.896s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Creating offline snapshot 6e91eab8-aca6-40ae-9396-6ab4b8fbf075 of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca65f5b0-2886-4a57-905b-76183281fdef tempest-VolumesDeleteCascade-508861973 None] Create snapshot completed successfully Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e67d7-f5cc-4be8-9100-2f24b08855e5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:53 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a Jul 21 19:13:53 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:54 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:54 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 1G Jul 21 19:13:54 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:54 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 1G" returned: 0 in 0.656s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:54 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:13:54 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:55 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 is being set with open permissions: ugo+rw Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:55 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:13:55 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:55 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:55 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info Jul 21 19:13:55 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:55 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info is being set with open permissions: ugo+rw Jul 21 19:13:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:55 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info Jul 21 19:13:55 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:56 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.info" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.428s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Creating offline snapshot d6bbde4b-04c6-4ce1-a290-0b9083827e96 of volume 1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec076ff1-22a9-40b6-b983-c6e543c160dc]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a6fa02e6-003f-41d7-84cd-17df9bdf9c89 tempest-SnapshotsActionsTest-238544476 None] Create snapshot completed successfully Jul 21 19:13:56 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:13:56 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:56 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abbe892-dc4c-45ef-8483-ed97999817d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:57 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 1G Jul 21 19:13:57 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:57 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 1G" returned: 0 in 1.007s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:58 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:13:58 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:13:58 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.687s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:58 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 is being set with open permissions: ugo+rw Jul 21 19:13:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:58 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:13:58 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:58 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.449s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Creating offline snapshot dbddf00b-dc71-4107-9d35-01dbff1802ac of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6534ca-7805-4dd9-8c79-1512b65b6464]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:13:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3545c6bd-f08e-4157-8fd9-291bc5e6a5e3 tempest-VolumesDeleteCascade-508861973 None] Create snapshot completed successfully Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:59 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:13:59 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:13:59 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.522s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:13:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:13:59 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac 1G Jul 21 19:13:59 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-1abbe892-dc4c-45ef-8483-ed97999817d2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-1abbe892-dc4c-45ef-8483-ed97999817d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-6b0d0064-3715-4931-82a9-dcd140b446cd-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-6b0d0064-3715-4931-82a9-dcd140b446cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-6b0d0064-3715-4931-82a9-dcd140b446cd" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:00 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac 1G" returned: 0 in 0.780s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-6b0d0064-3715-4931-82a9-dcd140b446cd" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:00 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac Jul 21 19:14:00 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Deleting offline snapshot 6b0d0064-3715-4931-82a9-dcd140b446cd of volume 1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] snapshot_file for this snap is: volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[11060946-0761-4df9-8695-d45c2fbe835c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:00 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:14:00 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:00 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac is being set with open permissions: ugo+rw Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:00 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac Jul 21 19:14:00 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:00 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abbe892-dc4c-45ef-8483-ed97999817d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6cf5a-069d-4067-bd49-6a59a3681ada]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:01 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:01 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:14:01 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d609e3b6-8c65-420f-a9de-8f76881b0f3d tempest-SnapshotsActionsTest-238544476 None] Create snapshot completed successfully Jul 21 19:14:01 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.580s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63eb28-25d1-4462-afd5-dc7f75e2ecf9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:01 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:14:01 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-dbddf00b-dc71-4107-9d35-01dbff1802ac-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-dbddf00b-dc71-4107-9d35-01dbff1802ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-dbddf00b-dc71-4107-9d35-01dbff1802ac" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-dbddf00b-dc71-4107-9d35-01dbff1802ac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Deleting offline snapshot dbddf00b-dc71-4107-9d35-01dbff1802ac of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] snapshot_file for this snap is: volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7d7b1f-3269-4d72-aef2-91cb29d775a2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abbe892-dc4c-45ef-8483-ed97999817d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[918d118d-000d-4390-b9bc-bb72eecb4c0f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac Jul 21 19:14:02 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:14:02 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abbe892-dc4c-45ef-8483-ed97999817d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:02 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac" returned: 0 in 0.507s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a98787-f718-4c6f-a55a-18200d055aba]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34daebeb-51d3-4c89-8fef-314bcfc63302]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:14:02 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:02 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Flow 'volume_create_manager' (1ba4b08d-0623-4f80-935a-ebd90dd9bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561959f3-fdde-435b-a4b5-2cd0625a247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561959f3-fdde-435b-a4b5-2cd0625a247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-687359421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cf8596-571c-477c-b734-50f1baa77bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f6cedcf6154a829d8bc37827310c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:03Z,use_quota=True,user_id='fa82811a1e834e5180910cd8b876304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb479f8-5c64-460f-9156-60f755630aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb479f8-5c64-460f-9156-60f755630aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066701e4-517e-4aaa-b742-6ccfacce413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066701e4-517e-4aaa-b742-6ccfacce413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cf8596-571c-477c-b734-50f1baa77bb8', 'volume_name': 'volume-d4cf8596-571c-477c-b734-50f1baa77bb8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce600038-a442-43f3-91b4-7a7f55791e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce600038-a442-43f3-91b4-7a7f55791e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cfd893-25bd-41e9-ade0-1499ab4c00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Volume d4cf8596-571c-477c-b734-50f1baa77bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cf8596-571c-477c-b734-50f1baa77bb8', 'volume_size': 1} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-687359421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cf8596-571c-477c-b734-50f1baa77bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f6cedcf6154a829d8bc37827310c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:03Z,use_quota=True,user_id='fa82811a1e834e5180910cd8b876304c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Creating volume d4cf8596-571c-477c-b734-50f1baa77bb8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:02 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 1073741824 Jul 21 19:14:02 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:14:03 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac Jul 21 19:14:03 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 1073741824" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 Jul 21 19:14:03 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd Jul 21 19:14:03 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac Jul 21 19:14:03 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cfd893-25bd-41e9-ade0-1499ab4c00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cf8596-571c-477c-b734-50f1baa77bb8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fedf44-452e-40a8-a5d3-d5087b04d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Volume volume-d4cf8596-571c-477c-b734-50f1baa77bb8 (d4cf8596-571c-477c-b734-50f1baa77bb8): created successfully Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fedf44-452e-40a8-a5d3-d5087b04d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Flow 'volume_create_manager' (1ba4b08d-0623-4f80-935a-ebd90dd9bff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81ff649d-22d0-4777-a86c-bb005b5c8fe6 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Created volume successfully. Jul 21 19:14:03 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.6b0d0064-3715-4931-82a9-dcd140b446cd" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 -F qcow2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:03 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 -F qcow2 Jul 21 19:14:03 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:03 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.dbddf00b-dc71-4107-9d35-01dbff1802ac" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-dbddf00b-dc71-4107-9d35-01dbff1802ac" released by "_delete_snapshot" :: held 1.896s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_snapshot" :: held 1.923s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Created reservations ['cd3f11e0-a6d2-4a2f-af83-4e310335c1ea', '31cfde49-4a5b-449e-96a4-5f2b5acef5b5', '563f175d-bb15-4d93-9e93-396ef0ef3510', '6a345740-15fe-4958-9bf7-15934bf10eac'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Delete snapshot completed successfully. Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e0dc1aa-6dfd-4ada-b565-59cf1919e6c1 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-dbddf00b-dc71-4107-9d35-01dbff1802ac-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abbe892-dc4c-45ef-8483-ed97999817d2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 -F qcow2" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-6b0d0064-3715-4931-82a9-dcd140b446cd" released by "_delete_snapshot" :: held 3.847s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" released by "delete_snapshot" :: held 3.900s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['e24e07a5-703c-464c-944c-434afd305acc', '0ea76ddc-6fc2-4872-b0de-73dbb6537f7b', 'e5a83bdf-8ceb-4278-8566-4c3b2ed19128', '21a527f4-aee9-4552-840a-eb44f17290df'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Delete snapshot completed successfully. Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-6b0d0064-3715-4931-82a9-dcd140b446cd-delete_snapshot" released by "delete_snapshot" :: held 4.125s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-d6bbde4b-04c6-4ce1-a290-0b9083827e96-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-d6bbde4b-04c6-4ce1-a290-0b9083827e96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-d6bbde4b-04c6-4ce1-a290-0b9083827e96" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Creating offline snapshot 71c341be-6c66-4404-90b5-f344f1a9ea78 of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-d6bbde4b-04c6-4ce1-a290-0b9083827e96" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Deleting offline snapshot d6bbde4b-04c6-4ce1-a290-0b9083827e96 of volume 1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] snapshot_file for this snap is: volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255c5c8-307b-43dc-a484-1c549f5bab0d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20260cf3-ec85-4bc2-8929-32e41c81b8c6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:04 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:04 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:04 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:14:04 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:05 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 1G Jul 21 19:14:05 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:05 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.455s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abbe892-dc4c-45ef-8483-ed97999817d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c1061-bf06-416e-a26c-f48921a1eebb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:14:05 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:05 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 1G" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 Jul 21 19:14:05 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:05 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:14:05 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:05 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 is being set with open permissions: ugo+rw Jul 21 19:14:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:05 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 Jul 21 19:14:05 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Acquiring lock "cinder-d4cf8596-571c-477c-b734-50f1baa77bb8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "cinder-d4cf8596-571c-477c-b734-50f1baa77bb8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=33,cinder:UPDATE=155,cinder:SELECT=130,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:14:06 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Acquiring lock "cinder-quobyte-d4cf8596-571c-477c-b734-50f1baa77bb8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96 Jul 21 19:14:06 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "cinder-quobyte-d4cf8596-571c-477c-b734-50f1baa77bb8" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20165a2b-9325-4295-927e-69a0303f2d6a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:06 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f075d81b-175a-4d0d-a837-fdf82fe45e6a tempest-SnapshotsActionsTest-238544476 None] Create snapshot completed successfully Jul 21 19:14:06 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 Jul 21 19:14:06 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2.d6bbde4b-04c6-4ce1-a290-0b9083827e96" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-d6bbde4b-04c6-4ce1-a290-0b9083827e96" released by "_delete_snapshot" :: held 1.880s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" released by "delete_snapshot" :: held 1.937s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['1f687a41-033b-49f4-ae34-eeca983b692b', 'ad194ce1-058a-4674-83a0-44ebd28f43b5', '5a08333e-e3a8-48fa-9e5b-8c2f773e4b9b', '00ad8786-2650-4726-9df4-feb5606fd94d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=138,cinder:DELETE=10,cinder:SELECT=130,cinder:INSERT=37 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:14:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Delete snapshot completed successfully. Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-d6bbde4b-04c6-4ce1-a290-0b9083827e96-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:06 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb99646-9326-4f7b-8509-fc8895f8f76d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:06 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8 Jul 21 19:14:06 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:14:06 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-71c341be-6c66-4404-90b5-f344f1a9ea78-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-71c341be-6c66-4404-90b5-f344f1a9ea78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-71c341be-6c66-4404-90b5-f344f1a9ea78" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-71c341be-6c66-4404-90b5-f344f1a9ea78" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Deleting offline snapshot 71c341be-6c66-4404-90b5-f344f1a9ea78 of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] snapshot_file for this snap is: volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:07 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d4cf8596-571c-477c-b734-50f1baa77bb8" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b6908f-adde-46ec-97ec-90cd506c54ec]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "cinder-quobyte-d4cf8596-571c-477c-b734-50f1baa77bb8" released by "delete_volume" :: held 0.882s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:07 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Created reservations ['760a47d9-165e-4664-a40f-1af660791fd1', 'ac6460ab-1dd9-48c8-9ca1-a317e9549494', 'd9ac5348-f59e-4e8e-8ba9-f17670fdaae4', 'ec1ad136-5547-4fc8-bc2a-d71189da452c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:07 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2 Jul 21 19:14:07 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 Jul 21 19:14:07 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:07 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1abbe892-dc4c-45ef-8483-ed97999817d2" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:07 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-1abbe892-dc4c-45ef-8483-ed97999817d2" released by "delete_volume" :: held 0.973s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Deleted volume successfully. Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ec134-a5a6-4d3d-908e-c5f776e3e792]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2cb6006-b8fd-431b-90a4-4c010ae854f0 tempest-VolumeQuotasNegativeTestJSON-254101052 None] Lock "cinder-d4cf8596-571c-477c-b734-50f1baa77bb8-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['6f2a59cf-d3f5-4b1b-bf4e-3e791545f44f', '4842d014-1c44-4008-b5f7-1048bd8cbea5', 'b848ea99-bb4d-4cce-8977-3986cab80960', 'a7e19689-8fa9-432c-8562-ce51c4156253'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:07 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:07 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:07 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:07 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:08 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:08 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 Jul 21 19:14:08 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:08 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Deleted volume successfully. Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1512d266-3442-4232-8499-b316b87ff447 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-1abbe892-dc4c-45ef-8483-ed97999817d2-delete_volume" released by "delete_volume" :: held 8.007s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:08 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78" returned: 0 in 0.639s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:08 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78 Jul 21 19:14:08 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (65457d18-f1e4-4d6d-9f6f-02957a4c3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f77408-68ce-4a4f-b873-46a5b15a3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f77408-68ce-4a4f-b873-46a5b15a3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-592024371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b86dcc-6309-4b70-98ee-e0be2aacb7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff5358edef4811b74073f48578f54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:09Z,use_quota=True,user_id='1c603a2330b54b5eb1e1a67c0098f8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cff84f0-9c78-44d7-8c87-5004f0026487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cff84f0-9c78-44d7-8c87-5004f0026487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343a2ee0-1a0d-4956-8b95-2a346248d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343a2ee0-1a0d-4956-8b95-2a346248d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b86dcc-6309-4b70-98ee-e0be2aacb7b3', 'volume_name': 'volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ac3f0a-7653-478a-99fc-0388004c6232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ac3f0a-7653-478a-99fc-0388004c6232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83cda70-10a8-4181-9694-444a9233637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Volume 89b86dcc-6309-4b70-98ee-e0be2aacb7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3', 'volume_size': 1} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-592024371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b86dcc-6309-4b70-98ee-e0be2aacb7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff5358edef4811b74073f48578f54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:09Z,use_quota=True,user_id='1c603a2330b54b5eb1e1a67c0098f8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Creating volume 89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:08 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 1073741824 Jul 21 19:14:08 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:09 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.71c341be-6c66-4404-90b5-f344f1a9ea78" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-71c341be-6c66-4404-90b5-f344f1a9ea78" released by "_delete_snapshot" :: held 2.169s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_snapshot" :: held 2.206s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Created reservations ['e96d3d0c-c9e7-429e-a218-641ad143fc8f', '7b8571cf-b728-493d-9877-24cdbf8bab6d', '8aba6779-63b9-4a50-a825-22f5db51d92c', 'abce8a39-9843-417f-9d17-ca3a6ff81696'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Delete snapshot completed successfully. Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-000cdb4c-3fc9-492c-a62e-adc8f0039cfa tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-71c341be-6c66-4404-90b5-f344f1a9ea78-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:09 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 1073741824" returned: 0 in 0.567s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:09 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:09 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:09 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83cda70-10a8-4181-9694-444a9233637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ebd50-9766-4927-aca1-9772f529f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Volume volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 (89b86dcc-6309-4b70-98ee-e0be2aacb7b3): created successfully Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918ebd50-9766-4927-aca1-9772f529f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (65457d18-f1e4-4d6d-9f6f-02957a4c3566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-331233ee-501b-4fc2-ade6-6e08db67ffc9 tempest-VolumesDeleteCascade-508861973 None] Created volume successfully. Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Creating offline snapshot 9eeee6f7-493a-4498-a73d-74dc9aa5482a of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4ee6d-580b-4075-87b9-111f2efdbfc9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:10 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:10 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Acquiring lock "cinder-cbadd4b3-52a4-4c42-816f-668a8150e262-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "cinder-cbadd4b3-52a4-4c42-816f-668a8150e262-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Acquiring lock "cinder-quobyte-cbadd4b3-52a4-4c42-816f-668a8150e262" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "cinder-quobyte-cbadd4b3-52a4-4c42-816f-668a8150e262" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f01c1-8fc6-4df9-a758-05738df237ec]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:11 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 Jul 21 19:14:11 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:11 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a 1G Jul 21 19:14:11 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:11 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262 Jul 21 19:14:11 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:11 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cbadd4b3-52a4-4c42-816f-668a8150e262" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:11 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a 1G" returned: 0 in 0.612s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "cinder-quobyte-cbadd4b3-52a4-4c42-816f-668a8150e262" released by "delete_volume" :: held 0.818s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:11 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a Jul 21 19:14:11 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Created reservations ['e620ee12-67b7-4482-9b7a-9bdfcb703920', '80d1452b-559e-4ca9-8275-8a6dd82d13b9', '1db8ad9e-59ce-4db6-a1ea-e7a1959304e5', 'fe13b185-e2b8-4773-8ded-e5ce9225770e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:11 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:11 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:12 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:12 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a is being set with open permissions: ugo+rw Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:12 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:12 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a Jul 21 19:14:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Deleted volume successfully. Jul 21 19:14:12 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c8378a0-5b3c-43b7-8247-51304eb4e8e0 tempest-VolumesNegativeTest-266505622 None] Lock "cinder-cbadd4b3-52a4-4c42-816f-668a8150e262-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:12 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.426s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Creating offline snapshot 67c96e9b-435d-46bc-b224-d53091b711e7 of volume 89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-16cba66e-0c51-458f-9d29-51c85bd88892 tempest-SnapshotsActionsTest-238544476 None] Create snapshot completed successfully Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea8a56-79fb-4f76-9ce1-b9ffff84d1c2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:12 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:12 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:13 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:13 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 1G Jul 21 19:14:13 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:13 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 1G" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:13 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:13 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-9eeee6f7-493a-4498-a73d-74dc9aa5482a-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-9eeee6f7-493a-4498-a73d-74dc9aa5482a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-9eeee6f7-493a-4498-a73d-74dc9aa5482a" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-9eeee6f7-493a-4498-a73d-74dc9aa5482a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Deleting offline snapshot 9eeee6f7-493a-4498-a73d-74dc9aa5482a of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] snapshot_file for this snap is: volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73c43e-f5bd-4ebe-b2cd-4c863bb46043]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:14 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a Jul 21 19:14:14 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:14 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:14 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 is being set with open permissions: ugo+rw Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:14 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:14 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:14 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a" returned: 0 in 0.522s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3eca3b-74f1-43e1-b731-8e00efdcc3bd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:14 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:14 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:14 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:14 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info Jul 21 19:14:14 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:15 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info is being set with open permissions: ugo+rw Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:15 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info Jul 21 19:14:15 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:15 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:15 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a Jul 21 19:14:15 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Flow 'volume_create_manager' (976a1e5b-992d-45ff-8e78-b9434dfd4b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f0709-3de6-418b-83d9-7f6e62fedb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f0709-3de6-418b-83d9-7f6e62fedb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-442924174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8e76de-f32a-4269-a732-a94ea92396b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6acdff4d974eee96dd9d4b170a33df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:15Z,use_quota=True,user_id='2529033311e545f9b4d5211da9434972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb056acd-21b7-4d81-abc3-04ffc5145518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb056acd-21b7-4d81-abc3-04ffc5145518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768f355c-8791-4550-8128-9546cf766d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768f355c-8791-4550-8128-9546cf766d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8e76de-f32a-4269-a732-a94ea92396b6', 'volume_name': 'volume-7a8e76de-f32a-4269-a732-a94ea92396b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac1a174-6731-46be-8180-c76c87d4cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac1a174-6731-46be-8180-c76c87d4cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d5fb3-af22-4959-a7ec-65b7ca118cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Volume 7a8e76de-f32a-4269-a732-a94ea92396b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8e76de-f32a-4269-a732-a94ea92396b6', 'volume_size': 1} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:15 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.info" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-442924174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8e76de-f32a-4269-a732-a94ea92396b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6acdff4d974eee96dd9d4b170a33df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:15Z,use_quota=True,user_id='2529033311e545f9b4d5211da9434972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Creating volume 7a8e76de-f32a-4269-a732-a94ea92396b6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:15 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 1073741824 Jul 21 19:14:15 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8542d390-018e-479c-ab58-40cfb919f8bc tempest-VolumesDeleteCascade-508861973 None] Create snapshot completed successfully Jul 21 19:14:15 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:15 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a Jul 21 19:14:15 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:15 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 1073741824" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:15 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.9eeee6f7-493a-4498-a73d-74dc9aa5482a" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:15 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 Jul 21 19:14:15 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-9eeee6f7-493a-4498-a73d-74dc9aa5482a" released by "_delete_snapshot" :: held 2.085s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_snapshot" :: held 2.119s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Created reservations ['f8fd7482-ac13-4fb2-86ec-52cae2b92f55', 'ca46347e-dce2-4c90-ad2c-181a5d71ab5e', '8661374f-6529-417e-9047-3e8ddeff9c3f', '82153f42-e967-4395-baa2-4f015bfaeafc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Delete snapshot completed successfully. Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61f9d484-8edb-441c-94e1-ba3f41b933a4 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-9eeee6f7-493a-4498-a73d-74dc9aa5482a-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:16 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d5fb3-af22-4959-a7ec-65b7ca118cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8e76de-f32a-4269-a732-a94ea92396b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35368956-2504-4d31-8f36-3e63843d2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Volume volume-7a8e76de-f32a-4269-a732-a94ea92396b6 (7a8e76de-f32a-4269-a732-a94ea92396b6): created successfully Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35368956-2504-4d31-8f36-3e63843d2365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Flow 'volume_create_manager' (976a1e5b-992d-45ff-8e78-b9434dfd4b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e3890e94-0b8f-447c-bd29-de50ab52188e tempest-VolumesServicesTestJSON-499155440 None] Created volume successfully. Jul 21 19:14:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (1bc3506a-0948-48e6-a7c2-97da8e629d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487a74d-ef1c-472a-924b-9494b43e2f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6487a74d-ef1c-472a-924b-9494b43e2f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145207089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ce971-5afe-4ac3-8091-44cf2bb42743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff5358edef4811b74073f48578f54a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67c96e9b-435d-46bc-b224-d53091b711e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:17Z,use_quota=True,user_id='1c603a2330b54b5eb1e1a67c0098f8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10042c96-55eb-4d61-9d0f-553698fa67b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10042c96-55eb-4d61-9d0f-553698fa67b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2908fec3-2f95-4191-ac62-9dd4a08f97f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2908fec3-2f95-4191-ac62-9dd4a08f97f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f15ce971-5afe-4ac3-8091-44cf2bb42743', 'volume_name': 'volume-f15ce971-5afe-4ac3-8091-44cf2bb42743', 'volume_size': 1, 'snapshot_id': '67c96e9b-435d-46bc-b224-d53091b711e7'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148e9d47-cab0-4164-ab57-fb795cee9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (148e9d47-cab0-4164-ab57-fb795cee9f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3eb69-c34a-456c-856f-06284cdfb0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Volume f15ce971-5afe-4ac3-8091-44cf2bb42743: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f15ce971-5afe-4ac3-8091-44cf2bb42743', 'volume_size': 1, 'snapshot_id': '67c96e9b-435d-46bc-b224-d53091b711e7'} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7-f15ce971-5afe-4ac3-8091-44cf2bb42743" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7-f15ce971-5afe-4ac3-8091-44cf2bb42743" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Creating volume f15ce971-5afe-4ac3-8091-44cf2bb42743 from snapshot 67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] snapshot: 67c96e9b-435d-46bc-b224-d53091b711e7, volume: f15ce971-5afe-4ac3-8091-44cf2bb42743, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1edf4f-79f1-4a22-9bf2-bad76f262786]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:17 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:17 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Acquiring lock "cinder-7a8e76de-f32a-4269-a732-a94ea92396b6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "cinder-7a8e76de-f32a-4269-a732-a94ea92396b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Acquiring lock "cinder-quobyte-7a8e76de-f32a-4269-a732-a94ea92396b6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "cinder-quobyte-7a8e76de-f32a-4269-a732-a94ea92396b6" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d95ea-c60b-4471-a7e6-d888cc8542a5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:17 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 Jul 21 19:14:17 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:17 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f989d31-b7b3-40fa-a0b5-5c3c97ee0da0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:17 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:17 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:18 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:18 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6 Jul 21 19:14:18 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:18 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:18 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 Jul 21 19:14:18 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:18 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7a8e76de-f32a-4269-a732-a94ea92396b6" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "cinder-quobyte-7a8e76de-f32a-4269-a732-a94ea92396b6" released by "delete_volume" :: held 0.761s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Created reservations ['106a0a60-5ce5-4e8c-a1aa-d2a67ee9b910', '2399c5a6-4507-4cc7-9e86-1ea4295b25c5', '82401900-0502-4d11-b6e3-56d41514bdbc', 'afaf5ee8-5034-42f5-867f-0a6ce5744b73'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:18 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:18 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:18 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Deleted volume successfully. Jul 21 19:14:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-18cbac17-45b9-4866-8ca5-c9f1202be4a3 tempest-VolumesServicesTestJSON-499155440 None] Lock "cinder-7a8e76de-f32a-4269-a732-a94ea92396b6-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:23 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743" returned: 0 in 5.651s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[65328c1f-bdfd-48d8-8f12-e1388d226139]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:24 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:24 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:24 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.610s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:14:24 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Converted 1024.00 MB image at 181.17 MB/s Jul 21 19:14:24 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 is being set with open permissions: ugo+rw Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:24 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 Jul 21 19:14:24 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:24 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" released by "_copy_volume_from_snapshot" :: held 7.657s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7-f15ce971-5afe-4ac3-8091-44cf2bb42743" released by "_create_volume_from_snapshot" :: held 7.705s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.330s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Creating offline snapshot f767e78a-d219-41fb-8f15-db2e490a66fd of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3eb69-c34a-456c-856f-06284cdfb0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15ce971-5afe-4ac3-8091-44cf2bb42743', 'volume_size': 1, 'snapshot_id': '67c96e9b-435d-46bc-b224-d53091b711e7'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5870ab97-87d5-495a-98b2-d2c83b1371d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba445f9-9d93-458a-88d7-3f702a0b30bb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Volume volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 (f15ce971-5afe-4ac3-8091-44cf2bb42743): created successfully Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5870ab97-87d5-495a-98b2-d2c83b1371d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Flow 'volume_create_manager' (1bc3506a-0948-48e6-a7c2-97da8e629d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3434cb29-fb2f-4414-bddc-baf40d3d4d91 tempest-VolumesDeleteCascade-508861973 None] Created volume successfully. Jul 21 19:14:25 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:25 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd 1G Jul 21 19:14:25 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:25 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:25 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd 1G" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:25 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd Jul 21 19:14:25 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:14:26 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd is being set with open permissions: ugo+rw Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd Jul 21 19:14:26 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-89b86dcc-6309-4b70-98ee-e0be2aacb7b3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-89b86dcc-6309-4b70-98ee-e0be2aacb7b3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-67c96e9b-435d-46bc-b224-d53091b711e7-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-67c96e9b-435d-46bc-b224-d53091b711e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Deleting offline snapshot 67c96e9b-435d-46bc-b224-d53091b711e7 of volume 89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] snapshot_file for this snap is: volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb272b-fd85-4bc8-96d7-ce4343385abd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:26 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd" returned: 0 in 0.491s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:26 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:26 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eb64ce91-6d2f-4141-a5a0-4a51ef923f04 tempest-SnapshotsActionsTest-238544476 None] Create snapshot completed successfully Jul 21 19:14:27 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.672s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-f767e78a-d219-41fb-8f15-db2e490a66fd-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a7d03-422c-4dc3-b390-b487f42da00f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-f767e78a-d219-41fb-8f15-db2e490a66fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Acquiring lock "cinder-quobyte-f767e78a-d219-41fb-8f15-db2e490a66fd" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-f767e78a-d219-41fb-8f15-db2e490a66fd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Deleting offline snapshot f767e78a-d219-41fb-8f15-db2e490a66fd of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] snapshot_file for this snap is: volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc8c49-0517-4ff8-ae9c-decd44f4f927]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:27 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:27 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:27 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd Jul 21 19:14:27 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.743s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ab124-5fa8-4e80-baed-5758f7fc5b31]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:28 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:28 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7 Jul 21 19:14:28 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:28 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd Jul 21 19:14:28 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:28 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3.67c96e9b-435d-46bc-b224-d53091b711e7" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-67c96e9b-435d-46bc-b224-d53091b711e7" released by "_delete_snapshot" :: held 2.349s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" released by "delete_snapshot" :: held 2.377s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['30739e6d-6ac5-422a-bf1b-7f2d0ae8d6a7', 'b995c3bb-51a8-4f89-9286-d6010df5c157', 'ebbdd4f0-1c29-4550-9b3b-d67e90bf34a8', '2f704b1a-c7df-46c7-8709-e927727bb92e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Delete snapshot completed successfully. Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-67c96e9b-435d-46bc-b224-d53091b711e7-delete_snapshot" released by "delete_snapshot" :: held 2.592s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69d9aa-6eb0-478e-b362-449c71aeb642]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:29 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd" returned: 0 in 0.561s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:29 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd Jul 21 19:14:29 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:29 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:29 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:29 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.f767e78a-d219-41fb-8f15-db2e490a66fd" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-f767e78a-d219-41fb-8f15-db2e490a66fd" released by "_delete_snapshot" :: held 2.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_snapshot" :: held 2.155s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:29 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Created reservations ['cac7e305-1815-42ff-920b-b720a59a10af', '659b31c0-8b1c-4ae4-9680-dd0798248bcb', '8aba7499-dc93-45cf-b4f5-e82862c5b930', '89bd9913-08b9-461b-8d28-31bf6e33afc4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:29 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3 Jul 21 19:14:29 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Delete snapshot completed successfully. Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0a679bc-453b-4c9b-ab57-43a30acc3e54 tempest-SnapshotsActionsTest-1066896718 None] Lock "cinder-f767e78a-d219-41fb-8f15-db2e490a66fd-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:29 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-89b86dcc-6309-4b70-98ee-e0be2aacb7b3" released by "delete_volume" :: held 0.898s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['cab6e796-1260-4232-a4b4-9a6727f297e0', 'd984654c-89ed-463f-b8e1-b9721f4cf992', 'fb0d7235-baed-4b10-9dbd-bdf752fcdb3d', '571a6a9f-db78-4099-9cbc-f3e131d746f7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:30 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:30 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:30 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Deleted volume successfully. Jul 21 19:14:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa10c0fb-3320-4e31-960e-63e75edafe93 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-89b86dcc-6309-4b70-98ee-e0be2aacb7b3-delete_volume" released by "delete_volume" :: held 4.174s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "cinder-6e91eab8-aca6-40ae-9396-6ab4b8fbf075-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-f15ce971-5afe-4ac3-8091-44cf2bb42743-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-6e91eab8-aca6-40ae-9396-6ab4b8fbf075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-f15ce971-5afe-4ac3-8091-44cf2bb42743-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "cinder-quobyte-6e91eab8-aca6-40ae-9396-6ab4b8fbf075" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-6e91eab8-aca6-40ae-9396-6ab4b8fbf075" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Deleting offline snapshot 6e91eab8-aca6-40ae-9396-6ab4b8fbf075 of volume 7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] snapshot_file for this snap is: volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e0ec2-30fb-48af-9454-a303b8375b2c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b1413c-e730-4383-ac9c-ada9c560ff65]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:31 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 Jul 21 19:14:31 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55bdaeb-7954-44da-b6cf-92ab082ddb45]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:31 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743 Jul 21 19:14:31 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:31 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a Jul 21 19:14:31 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f15ce971-5afe-4ac3-8091-44cf2bb42743" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-quobyte-f15ce971-5afe-4ac3-8091-44cf2bb42743" released by "delete_volume" :: held 0.911s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:32 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Created reservations ['f8f1d014-9b77-4ca8-afc6-499308a8a43a', '629dffcd-78ce-4677-827a-8a0407220f49', '9f97d073-a7d1-49c6-87e8-5cb9fd88035b', '49c4370f-a0c7-45ea-84cd-e1daddd73ea6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:32 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:32 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:32 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:32 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.570s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:32 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075 Jul 21 19:14:32 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:32 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Deleted volume successfully. Jul 21 19:14:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5d2ac21-b265-4624-84f0-7ad95fe95042 tempest-VolumesDeleteCascade-508861973 None] Lock "cinder-f15ce971-5afe-4ac3-8091-44cf2bb42743-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:33 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a.6e91eab8-aca6-40ae-9396-6ab4b8fbf075" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-6e91eab8-aca6-40ae-9396-6ab4b8fbf075" released by "_delete_snapshot" :: held 2.044s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_snapshot" :: held 2.089s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Created reservations ['c2cd6ab9-a1ae-4997-8f0c-6786be76f1d0', 'd3610717-5f75-478f-a051-1f789979c7e9', 'ab584752-e7ad-4760-96e9-b2198e6c04be', 'b225289c-710d-41c7-a14a-7996bd71077f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Delete snapshot completed successfully. Jul 21 19:14:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4bac310-7f2b-45ad-b872-96e9fd6313dd tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-6e91eab8-aca6-40ae-9396-6ab4b8fbf075-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "cinder-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1090b-32f9-4681-baf2-d998b439a876]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:34 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a Jul 21 19:14:34 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:35 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:35 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a Jul 21 19:14:35 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:35 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-quobyte-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a" released by "delete_volume" :: held 0.874s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Created reservations ['35029809-93a9-4d72-b1d6-de4bdf8b8b4f', 'f827a82b-c6e4-4166-b1ae-d8e711ce9ba3', 'ba437288-5cd2-4639-9749-4e348215c7da', 'ba4a52a8-b39f-4dcc-9380-5ac187fcc37a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:35 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:35 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:36 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Deleted volume successfully. Jul 21 19:14:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-202f67ff-c5bb-4c48-a8fb-c27e40c9f9a9 tempest-SnapshotsActionsTest-238544476 None] Lock "cinder-7d9ed45f-22d9-43ea-886e-ce81a5f2a98a-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Flow 'volume_create_manager' (d4f58237-dc0e-4f0f-91d5-62bb3923c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa6a4a-6d00-44f6-b33b-cc99edb794aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa6a4a-6d00-44f6-b33b-cc99edb794aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1742499823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e41ec2-f09a-456c-a135-d8ae0bec675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b34ccd0ce2468890e41ef827aba888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:39Z,use_quota=True,user_id='29b989256ac443beb26aecea6c9be580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c2ba96-2824-47c7-9ed8-9556ff6f9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c2ba96-2824-47c7-9ed8-9556ff6f9133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34845e81-9887-4a02-b847-15be23c017c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34845e81-9887-4a02-b847-15be23c017c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e41ec2-f09a-456c-a135-d8ae0bec675b', 'volume_name': 'volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5e970a-11a8-42ba-99d3-22341abadeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5e970a-11a8-42ba-99d3-22341abadeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78c8a3-7558-4f87-847c-2eedc01c091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Volume c7e41ec2-f09a-456c-a135-d8ae0bec675b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b', 'volume_size': 1} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1742499823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e41ec2-f09a-456c-a135-d8ae0bec675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b34ccd0ce2468890e41ef827aba888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:39Z,use_quota=True,user_id='29b989256ac443beb26aecea6c9be580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Creating volume c7e41ec2-f09a-456c-a135-d8ae0bec675b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:38 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b 1073741824 Jul 21 19:14:38 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:39 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b 1073741824" returned: 0 in 0.536s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:39 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b Jul 21 19:14:39 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:39 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce78c8a3-7558-4f87-847c-2eedc01c091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2532c8d4-77f2-4244-89da-dc1a4f8d2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Volume volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b (c7e41ec2-f09a-456c-a135-d8ae0bec675b): created successfully Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2532c8d4-77f2-4244-89da-dc1a4f8d2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Flow 'volume_create_manager' (d4f58237-dc0e-4f0f-91d5-62bb3923c961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0dccb367-3e93-47a5-a8d3-a040e36740ec tempest-VolumesMetadataTest-2117955599 None] Created volume successfully. Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Acquiring lock "cinder-c7e41ec2-f09a-456c-a135-d8ae0bec675b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "cinder-c7e41ec2-f09a-456c-a135-d8ae0bec675b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Acquiring lock "cinder-quobyte-c7e41ec2-f09a-456c-a135-d8ae0bec675b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "cinder-quobyte-c7e41ec2-f09a-456c-a135-d8ae0bec675b" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe8a7d-f709-4610-854f-631f325606bd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:42 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b Jul 21 19:14:42 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:42 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:42 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b Jul 21 19:14:42 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:42 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c7e41ec2-f09a-456c-a135-d8ae0bec675b" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "cinder-quobyte-c7e41ec2-f09a-456c-a135-d8ae0bec675b" released by "delete_volume" :: held 0.857s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Created reservations ['8b2e9492-f41d-46f3-aafa-651dc0125d9f', '84a596fe-4c6b-4b0d-821f-ceeadb515716', '97ecb742-6674-4c09-90bb-aa8b97c19eac', 'e59731c2-c01b-4d59-968a-a7a5cd8a1fb1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:43 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:43 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:43 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Deleted volume successfully. Jul 21 19:14:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5235e056-bd91-4e81-87e8-be467cd9b707 tempest-VolumesMetadataTest-2117955599 None] Lock "cinder-c7e41ec2-f09a-456c-a135-d8ae0bec675b-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (9b4233f6-5d22-4a82-a53c-e54ef780feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a036e1-d228-4ce0-8994-13c8199b9c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a036e1-d228-4ce0-8994-13c8199b9c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083565875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ddee4a-ab38-43be-9d84-0ae20c39775f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:47Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126a5f2e-1dc8-4d00-9865-232341f61dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126a5f2e-1dc8-4d00-9865-232341f61dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d15ec6-55e2-45ad-be82-34749da76cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d15ec6-55e2-45ad-be82-34749da76cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ddee4a-ab38-43be-9d84-0ae20c39775f', 'volume_name': 'volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6960d3d-5e0a-4526-b6a0-a8c6c4fd15c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6960d3d-5e0a-4526-b6a0-a8c6c4fd15c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047ce97-f83a-4b07-ad1e-610241be391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Volume b2ddee4a-ab38-43be-9d84-0ae20c39775f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f', 'volume_size': 1} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083565875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ddee4a-ab38-43be-9d84-0ae20c39775f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:47Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Creating volume b2ddee4a-ab38-43be-9d84-0ae20c39775f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:47 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f 1073741824 Jul 21 19:14:47 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:48 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f 1073741824" returned: 0 in 0.597s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:48 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f Jul 21 19:14:48 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:48 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a047ce97-f83a-4b07-ad1e-610241be391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee354da-66bd-470c-9bc8-f75c1db61eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Volume volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f (b2ddee4a-ab38-43be-9d84-0ae20c39775f): created successfully Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee354da-66bd-470c-9bc8-f75c1db61eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (9b4233f6-5d22-4a82-a53c-e54ef780feef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48bd97d7-de00-4512-8430-0403c75d26ec tempest-VolumesListAdminTestJSON-1887022455 None] Created volume successfully. Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Flow 'volume_create_manager' (8c992923-1dd6-4158-ab3f-6e18fe20a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f2f08d-a4d8-4601-8369-fb25afbfac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f2f08d-a4d8-4601-8369-fb25afbfac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1818550443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da0c5f1-8662-4afd-8338-e95dc3f01be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0936a8e2f54bde8278015f74c17e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:50Z,use_quota=True,user_id='970213f664114354bf641804c52d008e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59996bb9-9701-467f-b0f1-e8b469ac03d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59996bb9-9701-467f-b0f1-e8b469ac03d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30221d48-f88e-40e9-a4dd-75d6dd91bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30221d48-f88e-40e9-a4dd-75d6dd91bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da0c5f1-8662-4afd-8338-e95dc3f01be8', 'volume_name': 'volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93894b83-2552-46e0-af9e-5393bad1b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93894b83-2552-46e0-af9e-5393bad1b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f96310-4acb-4edb-8cf2-b0d1a5213fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Volume 7da0c5f1-8662-4afd-8338-e95dc3f01be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8', 'volume_size': 1} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1818550443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da0c5f1-8662-4afd-8338-e95dc3f01be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0936a8e2f54bde8278015f74c17e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:50Z,use_quota=True,user_id='970213f664114354bf641804c52d008e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Creating volume 7da0c5f1-8662-4afd-8338-e95dc3f01be8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:50 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 1073741824 Jul 21 19:14:50 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (762d478d-3f2c-4be7-a261-9e25762ce3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146afe57-8e02-4cd5-ac68-4ca7a6acdf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146afe57-8e02-4cd5-ac68-4ca7a6acdf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-845104620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d657fc-27ac-45c8-8f29-38eea579bb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:50Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4618828c-7631-4862-b150-2f5e4abb35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4618828c-7631-4862-b150-2f5e4abb35df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f775cdd6-e72e-4ede-9cd8-12347414c19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f775cdd6-e72e-4ede-9cd8-12347414c19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d657fc-27ac-45c8-8f29-38eea579bb07', 'volume_name': 'volume-b7d657fc-27ac-45c8-8f29-38eea579bb07', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c526bb-ccbb-4477-b4a3-a8debf80706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c526bb-ccbb-4477-b4a3-a8debf80706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d80e6-eeb8-4dec-87e6-6f7f759fb720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Volume b7d657fc-27ac-45c8-8f29-38eea579bb07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d657fc-27ac-45c8-8f29-38eea579bb07', 'volume_size': 1} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:50 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 1073741824" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:50 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 Jul 21 19:14:50 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:51 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-845104620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d657fc-27ac-45c8-8f29-38eea579bb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:50Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Creating volume b7d657fc-27ac-45c8-8f29-38eea579bb07 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:51 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 1073741824 Jul 21 19:14:51 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f96310-4acb-4edb-8cf2-b0d1a5213fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6dbf80-baf0-4922-b6f8-fcd1d3cadb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Volume volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 (7da0c5f1-8662-4afd-8338-e95dc3f01be8): created successfully Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6dbf80-baf0-4922-b6f8-fcd1d3cadb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Flow 'volume_create_manager' (8c992923-1dd6-4158-ab3f-6e18fe20a45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-937a5404-c220-4cc0-b3fe-ccfec518ce2d tempest-VolumesTransfersV355Test-759994236 None] Created volume successfully. Jul 21 19:14:52 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 1073741824" returned: 0 in 0.869s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:52 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 Jul 21 19:14:52 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:52 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d80e6-eeb8-4dec-87e6-6f7f759fb720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d657fc-27ac-45c8-8f29-38eea579bb07', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7905b2-d8dc-4c59-97d6-b4b23636e730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Volume volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 (b7d657fc-27ac-45c8-8f29-38eea579bb07): created successfully Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7905b2-d8dc-4c59-97d6-b4b23636e730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (762d478d-3f2c-4be7-a261-9e25762ce3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1fc7e6a2-7801-489e-b949-680c6950f881 tempest-VolumesListAdminTestJSON-1887022455 None] Created volume successfully. Jul 21 19:14:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e211235-c547-4f1c-888b-3fba79d827f5 tempest-VolumesTransfersV355Test-1112815326 None] Transfer volume completed successfully. Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (bf07d553-89dd-4f69-939c-df606932d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc72d21-07de-484a-a646-6f29a988c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc72d21-07de-484a-a646-6f29a988c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-332946983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6375e75e-fbb4-4916-8199-2490ec94f212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:55Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d684d-7ba2-42ea-bd16-0cce1b838403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562d684d-7ba2-42ea-bd16-0cce1b838403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da57a890-77bb-49b9-8bc7-0025feea8d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da57a890-77bb-49b9-8bc7-0025feea8d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6375e75e-fbb4-4916-8199-2490ec94f212', 'volume_name': 'volume-6375e75e-fbb4-4916-8199-2490ec94f212', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134f39f5-cb83-48d9-b52f-a8fae8f958c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134f39f5-cb83-48d9-b52f-a8fae8f958c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39654e-d744-40af-aecb-70fc016faeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Volume 6375e75e-fbb4-4916-8199-2490ec94f212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6375e75e-fbb4-4916-8199-2490ec94f212', 'volume_size': 1} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-332946983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6375e75e-fbb4-4916-8199-2490ec94f212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088d02b91e274d4fb7d579d5b65da6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:55Z,use_quota=True,user_id='9150da0b1cd04409bf3730d61c18985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Creating volume 6375e75e-fbb4-4916-8199-2490ec94f212 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:55 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 1073741824 Jul 21 19:14:55 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "cinder-7da0c5f1-8662-4afd-8338-e95dc3f01be8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-7da0c5f1-8662-4afd-8338-e95dc3f01be8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "cinder-quobyte-7da0c5f1-8662-4afd-8338-e95dc3f01be8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-quobyte-7da0c5f1-8662-4afd-8338-e95dc3f01be8" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e75b33-3c4c-4b32-9d00-3520bd221dff]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:55 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 Jul 21 19:14:55 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:55 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 1073741824" returned: 0 in 0.815s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:55 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:55 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8 Jul 21 19:14:55 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:55 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 Jul 21 19:14:55 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:56 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7da0c5f1-8662-4afd-8338-e95dc3f01be8" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-quobyte-7da0c5f1-8662-4afd-8338-e95dc3f01be8" released by "delete_volume" :: held 1.157s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:56 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39654e-d744-40af-aecb-70fc016faeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6375e75e-fbb4-4916-8199-2490ec94f212', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769d56a8-efaf-436e-8a91-230db2587ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Volume volume-6375e75e-fbb4-4916-8199-2490ec94f212 (6375e75e-fbb4-4916-8199-2490ec94f212): created successfully Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769d56a8-efaf-436e-8a91-230db2587ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Flow 'volume_create_manager' (bf07d553-89dd-4f69-939c-df606932d318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9cb37e8b-633b-4073-b864-d63083ae055a tempest-VolumesListAdminTestJSON-1887022455 None] Created volume successfully. Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Created reservations ['b6e4fece-39c9-48ec-a4d6-2d4c963d348a', '17c592ea-4a0e-4bd9-afa7-3e4a49b9f4b1', '24958e9e-a372-46f7-8b60-edfb9a6cbff8', '679c2c36-a4ea-4105-a0c8-a0d8e3bf26f0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:56 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:14:56 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:57 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:14:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Deleted volume successfully. Jul 21 19:14:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4ffe883-8017-46d5-8677-1aa51a557b62 tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-7da0c5f1-8662-4afd-8338-e95dc3f01be8-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Flow 'volume_create_manager' (151924d7-761c-4eb6-868e-5ec565f8b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7d1a3d-98e1-4fe0-a12f-911f6e5396d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7d1a3d-98e1-4fe0-a12f-911f6e5396d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e8a910-3ae3-4abf-926c-7859793fd363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4413385778499ba04890c802df4094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:58Z,use_quota=True,user_id='e4b6c3745c4c4ce7987eb33dfdc4672d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3774fc9-514b-4970-9102-2379b6156ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3774fc9-514b-4970-9102-2379b6156ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c383e7-2448-4c7b-a398-5f7637c6f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c383e7-2448-4c7b-a398-5f7637c6f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e8a910-3ae3-4abf-926c-7859793fd363', 'volume_name': 'volume-a8e8a910-3ae3-4abf-926c-7859793fd363', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900fa4b7-a043-4c8a-8827-1a336977fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900fa4b7-a043-4c8a-8827-1a336977fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0159920a-5515-40e6-8a48-a26147eb6c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Volume a8e8a910-3ae3-4abf-926c-7859793fd363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e8a910-3ae3-4abf-926c-7859793fd363', 'volume_size': 1} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e8a910-3ae3-4abf-926c-7859793fd363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e4413385778499ba04890c802df4094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:58Z,use_quota=True,user_id='e4b6c3745c4c4ce7987eb33dfdc4672d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Creating volume a8e8a910-3ae3-4abf-926c-7859793fd363 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:14:58 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 1073741824 Jul 21 19:14:58 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Flow 'volume_create_manager' (e2bcdf58-45eb-420f-8491-329e13d219c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195c84f5-ba4d-4cee-b771-d34a4baca5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195c84f5-ba4d-4cee-b771-d34a4baca5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-331488740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcc934c-b9b1-4af4-82f7-d5237d0fba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0936a8e2f54bde8278015f74c17e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:58Z,use_quota=True,user_id='970213f664114354bf641804c52d008e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7b4dc3-d08d-446d-89ec-f74569689ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7b4dc3-d08d-446d-89ec-f74569689ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29e5bf-2127-4e04-9e1c-8b809be50e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29e5bf-2127-4e04-9e1c-8b809be50e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcc934c-b9b1-4af4-82f7-d5237d0fba22', 'volume_name': 'volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a152cdd-8bc0-4d7d-ad79-65e69de77f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a152cdd-8bc0-4d7d-ad79-65e69de77f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6dae27-141f-4f7b-91f0-0ad0594c3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Volume 7bcc934c-b9b1-4af4-82f7-d5237d0fba22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22', 'volume_size': 1} Jul 21 19:14:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:59 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 1073741824" returned: 0 in 0.580s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:59 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 Jul 21 19:14:59 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:59 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-331488740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcc934c-b9b1-4af4-82f7-d5237d0fba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d0936a8e2f54bde8278015f74c17e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:14:58Z,use_quota=True,user_id='970213f664114354bf641804c52d008e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Creating volume 7bcc934c-b9b1-4af4-82f7-d5237d0fba22 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:14:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:14:59 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 1073741824 Jul 21 19:14:59 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0159920a-5515-40e6-8a48-a26147eb6c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e8a910-3ae3-4abf-926c-7859793fd363', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c9d14b-f8d7-414b-ae3d-5bcc954af4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:14:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Volume volume-a8e8a910-3ae3-4abf-926c-7859793fd363 (a8e8a910-3ae3-4abf-926c-7859793fd363): created successfully Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c9d14b-f8d7-414b-ae3d-5bcc954af4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:14:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Flow 'volume_create_manager' (151924d7-761c-4eb6-868e-5ec565f8b68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:14:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3effee0c-6c7e-4e0e-aac0-ec912734a26e tempest-VolumesListAdminTestJSON-1048788162 None] Created volume successfully. Jul 21 19:15:00 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 1073741824" returned: 0 in 0.491s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:00 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 Jul 21 19:15:00 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:00 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6dae27-141f-4f7b-91f0-0ad0594c3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129119f-46c2-4887-81a8-386abc752d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Acquiring lock "cinder-a8e8a910-3ae3-4abf-926c-7859793fd363-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Volume volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 (7bcc934c-b9b1-4af4-82f7-d5237d0fba22): created successfully Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b129119f-46c2-4887-81a8-386abc752d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Flow 'volume_create_manager' (e2bcdf58-45eb-420f-8491-329e13d219c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "cinder-a8e8a910-3ae3-4abf-926c-7859793fd363-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b463afe-9ca3-436c-98d2-73ca115f5167 tempest-VolumesTransfersV355Test-759994236 None] Created volume successfully. Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Acquiring lock "cinder-quobyte-a8e8a910-3ae3-4abf-926c-7859793fd363" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "cinder-quobyte-a8e8a910-3ae3-4abf-926c-7859793fd363" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9161616-ab4b-4373-b259-163cf60145d0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-6375e75e-fbb4-4916-8199-2490ec94f212-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-6375e75e-fbb4-4916-8199-2490ec94f212-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-quobyte-6375e75e-fbb4-4916-8199-2490ec94f212" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-6375e75e-fbb4-4916-8199-2490ec94f212" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99416e5-6efd-47fc-981d-cbc3abc75045]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:00 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 Jul 21 19:15:00 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:01 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 Jul 21 19:15:01 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:01 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363" returned: 0 in 0.551s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:01 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363 Jul 21 19:15:01 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:01 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:01 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212 Jul 21 19:15:01 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:01 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a8e8a910-3ae3-4abf-926c-7859793fd363" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "cinder-quobyte-a8e8a910-3ae3-4abf-926c-7859793fd363" released by "delete_volume" :: held 1.118s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:01 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6375e75e-fbb4-4916-8199-2490ec94f212" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-6375e75e-fbb4-4916-8199-2490ec94f212" released by "delete_volume" :: held 0.953s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Created reservations ['197905a8-e9f7-4f81-94d7-8c5a1aefcfd6', '839fe264-ad3d-4e7f-8dea-5a2bd0563306', '8bd736be-ad17-4feb-a6c5-9176830ed2a5', '32135dab-f6c3-4f31-b1a4-705e5a6f0a89'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Created reservations ['e4506a4b-82b0-4a5b-b095-94ea0eae8977', '529d062f-76a2-45ee-9bcf-32a3ab9a625b', 'f95677cc-1fd8-4884-9546-dd8a10c2d864', '6b0dec1d-8f43-47bc-b690-d82a09fb0530'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:02 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:02 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:02 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:02 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "cinder-7bcc934c-b9b1-4af4-82f7-d5237d0fba22-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-7bcc934c-b9b1-4af4-82f7-d5237d0fba22-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "cinder-quobyte-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-quobyte-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:02 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df64af-7f85-43a5-8c70-c66949f9bceb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:02 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Deleted volume successfully. Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96839377-ff8c-4901-80db-9ef0085a588a tempest-VolumesListAdminTestJSON-1048788162 None] Lock "cinder-a8e8a910-3ae3-4abf-926c-7859793fd363-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Deleted volume successfully. Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-653609d5-03b6-447d-b943-e33345e7a90c tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-6375e75e-fbb4-4916-8199-2490ec94f212-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:02 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 Jul 21 19:15:02 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:02 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:02 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22 Jul 21 19:15:02 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:03 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-b7d657fc-27ac-45c8-8f29-38eea579bb07-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-quobyte-7bcc934c-b9b1-4af4-82f7-d5237d0fba22" released by "delete_volume" :: held 0.813s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-b7d657fc-27ac-45c8-8f29-38eea579bb07-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-quobyte-b7d657fc-27ac-45c8-8f29-38eea579bb07" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Created reservations ['f5aea282-bbae-4e3d-8f44-13aa5455402b', '67c78a2f-da7b-40cb-880e-7c505fdf70f8', '442316cc-3696-465b-8240-17bd8dc0d037', '2018b71f-294e-4ae6-96aa-c13a45a080b1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-b7d657fc-27ac-45c8-8f29-38eea579bb07" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d335d-bf01-4677-868a-719dcb1b7504]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:03 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:03 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:03 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 Jul 21 19:15:03 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:04 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07" returned: 0 in 0.671s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:04 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.578s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Deleted volume successfully. Jul 21 19:15:04 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07 Jul 21 19:15:04 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-211d70fd-2010-4228-b609-819ef64b11cf tempest-VolumesTransfersV355Test-157529989 None] Lock "cinder-7bcc934c-b9b1-4af4-82f7-d5237d0fba22-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:04 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b7d657fc-27ac-45c8-8f29-38eea579bb07" returned: 0 in 0.513s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-b7d657fc-27ac-45c8-8f29-38eea579bb07" released by "delete_volume" :: held 1.248s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Created reservations ['e0d3d399-8723-4519-ba5f-c6ff5e6d3c64', 'b5d31c61-0a27-4bc3-802d-b043a51995f4', '9ca22cac-6f16-4acc-bc88-21563b3dd89d', '05f62add-080e-4ab7-a637-f289bf3929ae'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:04 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:04 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:05 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Deleted volume successfully. Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35523df1-4b0a-4c08-896d-cd5c9cd6c62f tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-b7d657fc-27ac-45c8-8f29-38eea579bb07-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-b2ddee4a-ab38-43be-9d84-0ae20c39775f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-b2ddee4a-ab38-43be-9d84-0ae20c39775f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "cinder-quobyte-b2ddee4a-ab38-43be-9d84-0ae20c39775f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-b2ddee4a-ab38-43be-9d84-0ae20c39775f" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d1fc52-a9ff-4a3d-826d-f44adc3f5f41]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:06 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f Jul 21 19:15:06 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:06 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:06 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f Jul 21 19:15:06 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:06 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b2ddee4a-ab38-43be-9d84-0ae20c39775f" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-quobyte-b2ddee4a-ab38-43be-9d84-0ae20c39775f" released by "delete_volume" :: held 0.912s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=119,cinder:INSERT=43,cinder:UPDATE=183,cinder:DELETE=14 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=129,cinder:INSERT=40,cinder:UPDATE=155,cinder:DELETE=12 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Created reservations ['1e96ba35-6307-45d9-acee-6eefc9629595', '8b5853eb-1e08-4d3f-bb15-f647e476ce72', '4a23430d-35b8-4319-8e74-50227f840372', 'aa8a5c37-1d26-4b00-a191-91fe486b60a2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:06 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:06 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:07 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Deleted volume successfully. Jul 21 19:15:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd1689e0-f188-45fe-9bda-5a947b9fca56 tempest-VolumesListAdminTestJSON-1887022455 None] Lock "cinder-b2ddee4a-ab38-43be-9d84-0ae20c39775f-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Flow 'volume_create_manager' (095db2c7-da39-4a2d-9d68-ea7e044ffbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf75e0-1934-4f86-8af7-57e1327ce6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cf75e0-1934-4f86-8af7-57e1327ce6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-292360987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad83ac9-189f-4d48-aa56-b62dc50882d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf18ae17c984a53a2866396cb949962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:12Z,use_quota=True,user_id='58f3953c66b8475f90bd4d77dc135472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791fdbc-231f-4685-b180-c472f0bc7457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791fdbc-231f-4685-b180-c472f0bc7457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fe897b-c374-46c8-8fa8-d030edc1a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fe897b-c374-46c8-8fa8-d030edc1a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad83ac9-189f-4d48-aa56-b62dc50882d8', 'volume_name': 'volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ac393-b65e-4b85-9d13-518910d3a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829ac393-b65e-4b85-9d13-518910d3a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d4ec51-6d33-4fbf-bd79-0b48a1b3e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Volume 1ad83ac9-189f-4d48-aa56-b62dc50882d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8', 'volume_size': 1} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-292360987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad83ac9-189f-4d48-aa56-b62dc50882d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf18ae17c984a53a2866396cb949962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:12Z,use_quota=True,user_id='58f3953c66b8475f90bd4d77dc135472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Creating volume 1ad83ac9-189f-4d48-aa56-b62dc50882d8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:12 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 1073741824 Jul 21 19:15:12 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:12 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 1073741824" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:12 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 Jul 21 19:15:12 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:13 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d4ec51-6d33-4fbf-bd79-0b48a1b3e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96291e2c-bcf7-4dd4-9867-c6142243297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Volume volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 (1ad83ac9-189f-4d48-aa56-b62dc50882d8): created successfully Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96291e2c-bcf7-4dd4-9867-c6142243297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Flow 'volume_create_manager' (095db2c7-da39-4a2d-9d68-ea7e044ffbba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f1f86a26-f421-4864-a3e0-49cdea6f4ba1 tempest-VolumesTransfersV357Test-1577995010 None] Created volume successfully. Jul 21 19:15:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-49b9a8b8-5f4f-42ee-b03f-787fb214eefd tempest-VolumesTransfersV357Test-1967105632 None] Transfer volume completed successfully. Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "cinder-1ad83ac9-189f-4d48-aa56-b62dc50882d8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-1ad83ac9-189f-4d48-aa56-b62dc50882d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "cinder-quobyte-1ad83ac9-189f-4d48-aa56-b62dc50882d8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-quobyte-1ad83ac9-189f-4d48-aa56-b62dc50882d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32698a3e-1e40-4bed-aca0-ee7e8f56d8b9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:16 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 Jul 21 19:15:16 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:16 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:16 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8 Jul 21 19:15:16 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:17 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1ad83ac9-189f-4d48-aa56-b62dc50882d8" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-quobyte-1ad83ac9-189f-4d48-aa56-b62dc50882d8" released by "delete_volume" :: held 0.860s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Created reservations ['483f96a2-727e-4f59-a80c-7620798a310f', '79e8266f-68dc-4b39-82b6-1bf132bb4715', 'bf30b1ce-21b9-4e08-9f1e-a6f641ef5527', '2041c444-0e73-46ff-a011-ff065b8c1513'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:17 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:17 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:17 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Deleted volume successfully. Jul 21 19:15:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30b286d7-eba1-436d-adcd-da951142807e tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-1ad83ac9-189f-4d48-aa56-b62dc50882d8-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Flow 'volume_create_manager' (d1fdecc8-06d0-49be-b574-ad421bf79925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8291da-f7a1-4479-b53e-acec8306c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8291da-f7a1-4479-b53e-acec8306c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1905407089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5049d734-d674-483a-ab08-63a718d1d1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf18ae17c984a53a2866396cb949962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:18Z,use_quota=True,user_id='58f3953c66b8475f90bd4d77dc135472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdaccc0-3133-4480-922e-8a097f53dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdaccc0-3133-4480-922e-8a097f53dcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503145a7-8a41-45be-9662-8e1745b2f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503145a7-8a41-45be-9662-8e1745b2f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5049d734-d674-483a-ab08-63a718d1d1ca', 'volume_name': 'volume-5049d734-d674-483a-ab08-63a718d1d1ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ee0eb-3e0b-41c6-91da-294f5c521859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ee0eb-3e0b-41c6-91da-294f5c521859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d5b45-c545-4663-8f30-05381c27fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Volume 5049d734-d674-483a-ab08-63a718d1d1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5049d734-d674-483a-ab08-63a718d1d1ca', 'volume_size': 1} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1905407089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5049d734-d674-483a-ab08-63a718d1d1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf18ae17c984a53a2866396cb949962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:18Z,use_quota=True,user_id='58f3953c66b8475f90bd4d77dc135472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Creating volume 5049d734-d674-483a-ab08-63a718d1d1ca {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:18 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca 1073741824 Jul 21 19:15:18 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Flow 'volume_create_manager' (14b6a453-c2ad-43cd-a959-1d4664e8f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4dfa94e-ee8a-410b-ab9e-15bee9074d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4dfa94e-ee8a-410b-ab9e-15bee9074d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-646651101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb02e0f3-3a87-4907-8d31-5577fa8ed1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2868cd5df0044fb7a895a00b8ee4041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:18Z,use_quota=True,user_id='ca388ac6a0ad47e49266d1effe44f574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34a0e4f-c797-4b93-b9ca-31e107d30357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34a0e4f-c797-4b93-b9ca-31e107d30357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca0c1cf-0d89-4d19-9855-3105db705d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca0c1cf-0d89-4d19-9855-3105db705d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb02e0f3-3a87-4907-8d31-5577fa8ed1b3', 'volume_name': 'volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c22803-cbd3-4c12-88dc-92e696555693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c22803-cbd3-4c12-88dc-92e696555693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e12fa4c-5d53-4c63-ad28-6de5b6d1f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Volume fb02e0f3-3a87-4907-8d31-5577fa8ed1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3', 'volume_size': 1} Jul 21 19:15:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:19 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca 1073741824" returned: 0 in 0.523s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:19 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca Jul 21 19:15:19 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:19 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-646651101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb02e0f3-3a87-4907-8d31-5577fa8ed1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2868cd5df0044fb7a895a00b8ee4041e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:18Z,use_quota=True,user_id='ca388ac6a0ad47e49266d1effe44f574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Creating volume fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d5b45-c545-4663-8f30-05381c27fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5049d734-d674-483a-ab08-63a718d1d1ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa48f4e1-53f7-4267-977c-71ee94cde47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:19 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 1073741824 Jul 21 19:15:19 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Volume volume-5049d734-d674-483a-ab08-63a718d1d1ca (5049d734-d674-483a-ab08-63a718d1d1ca): created successfully Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa48f4e1-53f7-4267-977c-71ee94cde47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Flow 'volume_create_manager' (d1fdecc8-06d0-49be-b574-ad421bf79925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c4328e80-99cf-4e02-895e-561939d908b4 tempest-VolumesTransfersV357Test-1577995010 None] Created volume successfully. Jul 21 19:15:20 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 1073741824" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:20 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 Jul 21 19:15:20 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:20 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e12fa4c-5d53-4c63-ad28-6de5b6d1f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43e091b-b7c4-444e-ad7c-7b4dc4a860b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Volume volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 (fb02e0f3-3a87-4907-8d31-5577fa8ed1b3): created successfully Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43e091b-b7c4-444e-ad7c-7b4dc4a860b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Flow 'volume_create_manager' (14b6a453-c2ad-43cd-a959-1d4664e8f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8949dd2f-1513-4059-8c40-10a824b71848 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Created volume successfully. Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "cinder-5049d734-d674-483a-ab08-63a718d1d1ca-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-5049d734-d674-483a-ab08-63a718d1d1ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Flow 'volume_create_manager' (a7ca0b54-1841-4e8a-a62e-7bd90feb832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7fdab-6949-436b-801b-5e9e725f9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b7fdab-6949-436b-801b-5e9e725f9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-428136728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc16f17-2e7e-42c4-aa9b-e59344ce7f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b064f6dc103a492599b34d73f3b802c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:21Z,use_quota=True,user_id='cfa57faafe90426c81f79d5e81a4fae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd338503-5d34-4c4d-9c8e-bd827022b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd338503-5d34-4c4d-9c8e-bd827022b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54b9323-6aef-4be5-b91a-e85c24dd3e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "cinder-quobyte-5049d734-d674-483a-ab08-63a718d1d1ca" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-quobyte-5049d734-d674-483a-ab08-63a718d1d1ca" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4273ed-768c-4979-83c4-43e60924fd64]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:20 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca Jul 21 19:15:20 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54b9323-6aef-4be5-b91a-e85c24dd3e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edc16f17-2e7e-42c4-aa9b-e59344ce7f8c', 'volume_name': 'volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07611f46-aca0-466e-8912-06bf6b0db76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07611f46-aca0-466e-8912-06bf6b0db76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38d6831-4e66-4246-99a1-375f19fcc7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Trying to clone edc16f17-2e7e-42c4-aa9b-e59344ce7f8c from image be5d1921-2dfc-4e84-8720-ad78553464c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:15:21 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:21 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca Jul 21 19:15:21 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:21 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5049d734-d674-483a-ab08-63a718d1d1ca" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-quobyte-5049d734-d674-483a-ab08-63a718d1d1ca" released by "delete_volume" :: held 1.034s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:15:21 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204f3ac-5956-4603-b375-3b68e0737f92]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Created reservations ['87510091-b899-4279-9fba-b2aebfeac4b2', '48adfdff-7432-4f6f-ab0c-f7629c90fd42', '4f064178-0548-4dae-afd5-7560370b4e38', 'fd30aeae-c115-4570-ad87-350dd5fc73ee'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:22 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:22 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD Jul 21 19:15:22 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:22 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:22 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Deleted volume successfully. Jul 21 19:15:22 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 is fetched for user cfa57faafe90426c81f79d5e81a4fae5. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d1fb80ad-d936-43c6-9518-683b60d07f3f tempest-VolumesTransfersV357Test-963263716 None] Lock "cinder-5049d734-d674-483a-ab08-63a718d1d1ca-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcea5281-ea09-40ca-8d67-8adf17fb0957]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:22 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD Jul 21 19:15:22 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-52d01ae8-464c-494e-a20f-9427c49d941d req-10a4ef54-0b4c-4a6e-a4a0-43becdbbaa87 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-52d01ae8-464c-494e-a20f-9427c49d941d req-10a4ef54-0b4c-4a6e-a4a0-43becdbbaa87 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-52d01ae8-464c-494e-a20f-9427c49d941d req-10a4ef54-0b4c-4a6e-a4a0-43becdbbaa87 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-52d01ae8-464c-494e-a20f-9427c49d941d req-10a4ef54-0b4c-4a6e-a4a0-43becdbbaa87 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '277290b9-c38b-4a0b-8385-350c8e715269', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:15:22 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-428136728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc16f17-2e7e-42c4-aa9b-e59344ce7f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b064f6dc103a492599b34d73f3b802c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:21Z,use_quota=True,user_id='cfa57faafe90426c81f79d5e81a4fae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Creating volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:22 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1073741824 Jul 21 19:15:22 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-52d01ae8-464c-494e-a20f-9427c49d941d req-10a4ef54-0b4c-4a6e-a4a0-43becdbbaa87 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] attachment_update completed successfully. Jul 21 19:15:23 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1073741824" returned: 0 in 0.681s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:23 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c Jul 21 19:15:23 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:24 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Attempting download of be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95151d-3f47-4eed-8cad-1ebdefb85baf]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:24 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc Jul 21 19:15:24 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:24 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:24 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc Jul 21 19:15:24 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:25 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc" returned: 1 in 0.476s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_fmikrfuc' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62da0868-39c5-413c-a6aa-3caa66cb90b3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:25 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD Jul 21 19:15:25 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:25 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] be5d1921-2dfc-4e84-8720-ad78553464c1 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:15:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:25 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:25 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:25 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c Jul 21 19:15:25 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:26 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:15:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:15:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:15:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-3cfc00db-9f17-4fce-b121-3f229a0c692c req-8697cc54-9959-4e5b-89dc-e7580f2a934f tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Terminate volume connection completed successfully. Jul 21 19:15:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-3cfc00db-9f17-4fce-b121-3f229a0c692c req-8697cc54-9959-4e5b-89dc-e7580f2a934f tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Deleting attachment 277290b9-c38b-4a0b-8385-350c8e715269. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "cinder-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "cinder-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "cinder-quobyte-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "cinder-quobyte-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:28 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" returned: 0 in 2.690s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1__kta1gtedevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:15:28 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Converted 112.00 MB image at 41.61 MB/s Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f481e-81d1-45e0-b676-4991feab9b6b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:28 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1G Jul 21 19:15:28 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:28 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 Jul 21 19:15:28 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:28 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c 1G" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Downloaded image be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 for user cfa57faafe90426c81f79d5e81a4fae5 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Marking volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Copying metadata from image be5d1921-2dfc-4e84-8720-ad78553464c1 to edc16f17-2e7e-42c4-aa9b-e59344ce7f8c. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:15:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Creating volume glance metadata for volume edc16f17-2e7e-42c4-aa9b-e59344ce7f8c backed by image be5d1921-2dfc-4e84-8720-ad78553464c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:15:28 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" returned: 0 in 0.540s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:29 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3 Jul 21 19:15:29 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38d6831-4e66-4246-99a1-375f19fcc7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f2e97a-884e-4b6e-8825-8237c454158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Volume volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c (edc16f17-2e7e-42c4-aa9b-e59344ce7f8c): created successfully Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f2e97a-884e-4b6e-8825-8237c454158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Flow 'volume_create_manager' (a7ca0b54-1841-4e8a-a62e-7bd90feb832e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-17258ac8-0760-4d10-8b3b-6946ae4b8dd3 tempest-VolumesImageMetadata-1076435357 None] Created volume successfully. Jul 21 19:15:29 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "cinder-quobyte-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3" released by "delete_volume" :: held 0.910s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Created reservations ['aa6fa2e9-02b3-43d6-abe6-f0d75e4e3fda', '8076a332-605a-4713-9388-12b7224c1608', 'eddd6cb4-ad6e-47af-861d-f21baf2c75dd', '5ff8719c-71b9-4c51-afb6-80523575c148'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:29 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:29 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Acquiring lock "cinder-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "cinder-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Acquiring lock "cinder-quobyte-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "cinder-quobyte-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:29 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86497c5-bb13-4137-ba3a-0e549355b471]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Deleted volume successfully. Jul 21 19:15:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af588be5-f014-4fff-9f49-604689b278f6 tempest-TestServerVolumeAttachScenarioOldVersion-238331854 None] Lock "cinder-fb02e0f3-3a87-4907-8d31-5577fa8ed1b3-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:30 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c Jul 21 19:15:30 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:30 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:30 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c Jul 21 19:15:30 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:30 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "cinder-quobyte-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c" released by "delete_volume" :: held 1.032s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Created reservations ['a103392c-d760-4057-a729-b82938a3ef21', 'a2c7c47f-25fe-49b3-b0bc-7ebddd676ca3', '2c2d497f-daa8-4278-8d2d-99591d3f8dec', '23017f0c-db18-43be-8f18-5afbbe3ae406'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:31 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:31 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:31 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.687s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Deleted volume successfully. Jul 21 19:15:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa8d079e-753f-48d9-a857-9eb48344b793 tempest-VolumesImageMetadata-1076435357 None] Lock "cinder-edc16f17-2e7e-42c4-aa9b-e59344ce7f8c-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Flow 'volume_create_manager' (b178e298-0d48-4519-beed-6023589d2073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84689aff-4602-4643-a24e-d5cfacae517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84689aff-4602-4643-a24e-d5cfacae517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-894163833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3de84b40a5149be8c6496676824fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:35Z,use_quota=True,user_id='9e5e6d1aeb0f4403aaea15d7a4b2fea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf627b2c-b7e7-4955-9661-1716e999f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf627b2c-b7e7-4955-9661-1716e999f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b5adc-9321-474d-bf91-968228585786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921b5adc-9321-474d-bf91-968228585786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'volume_name': 'volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75f3f1-c862-488a-84dc-909ec27a81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a75f3f1-c862-488a-84dc-909ec27a81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5426a-00ee-454d-b5f7-cfc5ed76cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Volume fad1561d-7d18-46c9-a4ed-656f8bd9e9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'volume_size': 1} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-894163833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3de84b40a5149be8c6496676824fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:35Z,use_quota=True,user_id='9e5e6d1aeb0f4403aaea15d7a4b2fea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Creating volume fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:35 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea 1073741824 Jul 21 19:15:35 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:36 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea 1073741824" returned: 0 in 0.696s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:36 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:36 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:36 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5426a-00ee-454d-b5f7-cfc5ed76cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f20563-0bd1-4133-a1bc-33ce13d8e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Volume volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea (fad1561d-7d18-46c9-a4ed-656f8bd9e9ea): created successfully Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f20563-0bd1-4133-a1bc-33ce13d8e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Flow 'volume_create_manager' (b178e298-0d48-4519-beed-6023589d2073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-585fa045-e10e-4c16-970c-95bcd981974f tempest-VolumesCloneTest-1875699329 None] Created volume successfully. Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Flow 'volume_create_manager' (cc96d45e-a5c1-4da1-be90-8c86f2ae5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5e0769-a7f6-402f-9c39-55150a13aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5e0769-a7f6-402f-9c39-55150a13aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-470131306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a13da4-4366-49af-b943-b2e815bab55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea185771bdf45de8aa4712d1a1d6b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:37Z,use_quota=True,user_id='3fc1233c4ee843708bb24ed63468069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df498551-d683-4f5d-ab40-d7cb7bc64244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df498551-d683-4f5d-ab40-d7cb7bc64244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50cd1ca-b680-463c-9078-37e3ccf9e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50cd1ca-b680-463c-9078-37e3ccf9e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a13da4-4366-49af-b943-b2e815bab55f', 'volume_name': 'volume-35a13da4-4366-49af-b943-b2e815bab55f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205593dc-a917-4eea-b72b-8b5a455d664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205593dc-a917-4eea-b72b-8b5a455d664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a429f398-606c-41d5-9dee-99d91bbb4e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Volume 35a13da4-4366-49af-b943-b2e815bab55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a13da4-4366-49af-b943-b2e815bab55f', 'volume_size': 1} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-470131306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a13da4-4366-49af-b943-b2e815bab55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea185771bdf45de8aa4712d1a1d6b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:37Z,use_quota=True,user_id='3fc1233c4ee843708bb24ed63468069c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Creating volume 35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:37 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f 1073741824 Jul 21 19:15:37 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:38 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f 1073741824" returned: 0 in 0.820s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:38 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f Jul 21 19:15:38 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Flow 'volume_create_manager' (dcef5c30-eaae-46e8-a201-43c100c9eccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b34267-8e0f-474e-a29a-b08ed55b44fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b34267-8e0f-474e-a29a-b08ed55b44fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-504793338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=689a349d-51b6-448e-947a-76e72e8a37a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3de84b40a5149be8c6496676824fc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:39Z,use_quota=True,user_id='9e5e6d1aeb0f4403aaea15d7a4b2fea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a807aa2-ec98-44fd-b8bf-ae83b5841534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a807aa2-ec98-44fd-b8bf-ae83b5841534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b654dd1-e45d-4620-99eb-688554499051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b654dd1-e45d-4620-99eb-688554499051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '689a349d-51b6-448e-947a-76e72e8a37a1', 'volume_name': 'volume-689a349d-51b6-448e-947a-76e72e8a37a1', 'volume_size': 2, 'source_volid': 'fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9523339-5ce0-4262-85fe-4d86c748ee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9523339-5ce0-4262-85fe-4d86c748ee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f12073-7bbe-4ec7-8bf5-ac43aaf71445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Volume 689a349d-51b6-448e-947a-76e72e8a37a1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-689a349d-51b6-448e-947a-76e72e8a37a1', 'volume_size': 2, 'source_volid': 'fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'source_volstatus': 'available'} Jul 21 19:15:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:39 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f" returned: 0 in 0.514s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.099s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Cloning volume fad1561d-7d18-46c9-a4ed-656f8bd9e9ea to volume 689a349d-51b6-448e-947a-76e72e8a37a1 Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a429f398-606c-41d5-9dee-99d91bbb4e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a13da4-4366-49af-b943-b2e815bab55f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d7dc0f-caae-442d-8257-68f8c488717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Volume volume-35a13da4-4366-49af-b943-b2e815bab55f (35a13da4-4366-49af-b943-b2e815bab55f): created successfully Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d7dc0f-caae-442d-8257-68f8c488717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Flow 'volume_create_manager' (cc96d45e-a5c1-4da1-be90-8c86f2ae5939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce1dba95-e9ea-468e-a98b-95d76831a54f tempest-SnapshotMetadataTestJSON-1431422453 None] Created volume successfully. Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Creating offline snapshot c73985c6-3840-4435-9267-5cbc12cd620b of volume fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da9fd1d-5f04-480c-8c26-604b09ad6942]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:39 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:39 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:39 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.683s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:39 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b 1G Jul 21 19:15:39 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:40 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b 1G" returned: 0 in 0.689s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:40 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:40 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (1527dbe0-cd58-4843-a6ec-b20f8b4e0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632fd69f-d854-4505-8620-8baecb753971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632fd69f-d854-4505-8620-8baecb753971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-57325682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249a8072-bd47-4614-97d1-2ceb67bfdccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:41Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7020299-2fa0-4f4b-bc57-d933623e3fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7020299-2fa0-4f4b-bc57-d933623e3fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2bacf3e-5d4b-4583-b5e7-6835b17ade4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2bacf3e-5d4b-4583-b5e7-6835b17ade4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249a8072-bd47-4614-97d1-2ceb67bfdccb', 'volume_name': 'volume-249a8072-bd47-4614-97d1-2ceb67bfdccb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90900328-dcdb-4e55-83c9-4b9c10347dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90900328-dcdb-4e55-83c9-4b9c10347dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbbf825-7853-44d9-9737-f2a485fc9312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Volume 249a8072-bd47-4614-97d1-2ceb67bfdccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249a8072-bd47-4614-97d1-2ceb67bfdccb', 'volume_size': 1} Jul 21 19:15:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:40 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b is being set with open permissions: ugo+rw Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:41 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:41 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:41 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:41 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info Jul 21 19:15:41 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:41 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info is being set with open permissions: ugo+rw Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:41 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info Jul 21 19:15:41 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:41 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.info" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] snapshot: c73985c6-3840-4435-9267-5cbc12cd620b, volume: 689a349d-51b6-448e-947a-76e72e8a37a1, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d8479-4bda-4d68-9228-577a2470a1b5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:42 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:42 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:42 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc399e-b844-4e86-a6c0-87c8a8ff9f67]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:42 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:42 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:43 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.558s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:43 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:15:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:43 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 Jul 21 19:15:43 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:49 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1" returned: 0 in 6.543s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[398cb877-ce83-4b9f-b479-48a6bb44e5cd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:49 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:49 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:50 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.614s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:15:50 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Converted 1024.00 MB image at 156.47 MB/s Jul 21 19:15:50 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 is being set with open permissions: ugo+rw Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:50 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 Jul 21 19:15:50 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:50 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" released by "_copy_volume_from_snapshot" :: held 8.632s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-quobyte-c73985c6-3840-4435-9267-5cbc12cd620b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-c73985c6-3840-4435-9267-5cbc12cd620b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Deleting offline snapshot c73985c6-3840-4435-9267-5cbc12cd620b of volume fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] snapshot_file for this snap is: volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3fc0f3-301d-474a-bcc8-7254e10fc454]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:50 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:50 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:51 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=57,cinder:INSERT=28,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1da22-25f4-4b3f-895b-f3d9f5725452]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:51 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:51 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:51 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.505s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:51 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:51 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:52 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:52 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b Jul 21 19:15:52 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:52 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea.c73985c6-3840-4435-9267-5cbc12cd620b" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-c73985c6-3840-4435-9267-5cbc12cd620b" released by "_delete_snapshot" :: held 1.829s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.553s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.688s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f12073-7bbe-4ec7-8bf5-ac43aaf71445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-689a349d-51b6-448e-947a-76e72e8a37a1', 'volume_size': 2, 'source_volid': 'fad1561d-7d18-46c9-a4ed-656f8bd9e9ea', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da05501-4b7c-4d79-9a6f-514ade407cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Creating offline snapshot c496de84-e6a9-49e9-96a4-efa5b3b49ec7 of volume 35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:15:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Volume volume-689a349d-51b6-448e-947a-76e72e8a37a1 (689a349d-51b6-448e-947a-76e72e8a37a1): created successfully Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da05501-4b7c-4d79-9a6f-514ade407cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Flow 'volume_create_manager' (dcef5c30-eaae-46e8-a201-43c100c9eccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a123250-c9d9-418f-adf1-3e176fec481b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7805c4c7-f99f-4f20-9cc2-bbde1ce03c16 tempest-VolumesCloneTest-1875699329 None] Created volume successfully. Jul 21 19:15:52 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f Jul 21 19:15:52 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:53 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 1G Jul 21 19:15:53 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 1G" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a13da4-4366-49af-b943-b2e815bab55f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:53 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a13da4-4366-49af-b943-b2e815bab55f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 Jul 21 19:15:53 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-689a349d-51b6-448e-947a-76e72e8a37a1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "cinder-689a349d-51b6-448e-947a-76e72e8a37a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62baaeef-12be-451d-b339-b4cacd5211ce]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:53 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35a13da4-4366-49af-b943-b2e815bab55f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 is being set with open permissions: ugo+rw Jul 21 19:15:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:53 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 Jul 21 19:15:53 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:53 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 Jul 21 19:15:53 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:54 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info Jul 21 19:15:54 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:54 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1 Jul 21 19:15:54 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info is being set with open permissions: ugo+rw Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:54 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info Jul 21 19:15:54 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-689a349d-51b6-448e-947a-76e72e8a37a1" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-689a349d-51b6-448e-947a-76e72e8a37a1" released by "delete_volume" :: held 0.700s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Created reservations ['5a1b45a0-c386-4465-94c8-823b7989f0e5', 'c474d2fd-52c4-44e4-90bd-2ae3a584c7f7', 'e83a5ff0-e3f6-45d8-8be6-5d235cc6f643', '27e72fc0-0941-4e95-a049-2211dd532aed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:54 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:54 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.info" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.840s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-57325682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249a8072-bd47-4614-97d1-2ceb67bfdccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:15:41Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Creating volume 249a8072-bd47-4614-97d1-2ceb67bfdccb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:15:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:54 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb 1073741824 Jul 21 19:15:54 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-38388c0b-df6a-42d5-a7ee-35e01a7a1651 tempest-SnapshotMetadataTestJSON-1431422453 None] Create snapshot completed successfully Jul 21 19:15:54 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Deleted volume successfully. Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40fb1c96-eaaa-4090-a0d3-179f2972a74b tempest-VolumesCloneTest-1875699329 None] Lock "cinder-689a349d-51b6-448e-947a-76e72e8a37a1-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "cinder-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Acquiring lock "cinder-quobyte-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f8374-1242-4b8d-9b58-117a71e69f6c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:55 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:55 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:55 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb 1073741824" returned: 0 in 0.677s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:55 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb Jul 21 19:15:55 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:55 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:55 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea Jul 21 19:15:55 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:55 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbbf825-7853-44d9-9737-f2a485fc9312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249a8072-bd47-4614-97d1-2ceb67bfdccb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079afb56-25f7-4a55-bfdc-d5e4e89f59ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:15:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Volume volume-249a8072-bd47-4614-97d1-2ceb67bfdccb (249a8072-bd47-4614-97d1-2ceb67bfdccb): created successfully Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079afb56-25f7-4a55-bfdc-d5e4e89f59ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:15:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (1527dbe0-cd58-4843-a6ec-b20f8b4e0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:15:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-73cd8169-bc09-4192-bac1-67cf91fe0dfa tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:15:55 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "cinder-c496de84-e6a9-49e9-96a4-efa5b3b49ec7-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "cinder-quobyte-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea" released by "delete_volume" :: held 0.959s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-c496de84-e6a9-49e9-96a4-efa5b3b49ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "cinder-quobyte-c496de84-e6a9-49e9-96a4-efa5b3b49ec7" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-c496de84-e6a9-49e9-96a4-efa5b3b49ec7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Deleting offline snapshot c496de84-e6a9-49e9-96a4-efa5b3b49ec7 of volume 35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] snapshot_file for this snap is: volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94310c71-1e43-450b-b7a5-a19b65d10c51]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Created reservations ['6c528713-4ec3-4743-88a6-a86b91edc048', 'bc60c139-6b0a-4df3-a991-09409901c5d9', 'a67d815a-c9e5-4306-8b36-ae27393b7b3f', '0e767d62-87d0-49fe-ac59-308a8410bda9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 Jul 21 19:15:56 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:56 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:15:56 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cebdd29-f883-41f4-ac38-2e81c554a364 tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cebdd29-f883-41f4-ac38-2e81c554a364 tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb" acquired by "attach_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:56 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:15:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Deleted volume successfully. Jul 21 19:15:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5cebdd29-f883-41f4-ac38-2e81c554a364 tempest-VolumesActionsTest-814178139 None] Attaching volume 249a8072-bd47-4614-97d1-2ceb67bfdccb to instance 260b5bf0-1664-4a6e-ae17-666dba138aff at mountpoint /dev/vdb on host None. Jul 21 19:15:56 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9dfb6c5-b575-4c7c-a27d-bbe716a6752e tempest-VolumesCloneTest-1875699329 None] Lock "cinder-fad1561d-7d18-46c9-a4ed-656f8bd9e9ea-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35a13da4-4366-49af-b943-b2e815bab55f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77f26a-c263-4a18-ac86-0ad0b02c1ece]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5cebdd29-f883-41f4-ac38-2e81c554a364 tempest-VolumesActionsTest-814178139 None] Attach volume completed successfully. Jul 21 19:15:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cebdd29-f883-41f4-ac38-2e81c554a364 tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb" released by "attach_volume" :: held 0.179s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:56 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f Jul 21 19:15:56 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 Jul 21 19:15:57 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Terminate volume connection completed successfully. Jul 21 19:15:57 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7" returned: 0 in 0.644s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:57 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7 Jul 21 19:15:57 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Detaching volume 249a8072-bd47-4614-97d1-2ceb67bfdccb from instance 260b5bf0-1664-4a6e-ae17-666dba138aff. Jul 21 19:15:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Detach volume completed successfully. Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7efa9057-0081-4051-a9f7-e5c4887520c0 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:58 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f.c496de84-e6a9-49e9-96a4-efa5b3b49ec7" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d71a389d-207e-4f1c-ad80-4c62c6811656 tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-c496de84-e6a9-49e9-96a4-efa5b3b49ec7" released by "_delete_snapshot" :: held 2.201s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" released by "delete_snapshot" :: held 2.253s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d71a389d-207e-4f1c-ad80-4c62c6811656 tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d71a389d-207e-4f1c-ad80-4c62c6811656 tempest-VolumesActionsTest-814178139 None] Volume detach called, but volume not attached. Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d71a389d-207e-4f1c-ad80-4c62c6811656 tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Created reservations ['8a9e9546-d03d-4a61-88a3-7466dcc9487d', '3bc60044-a539-4a34-a725-abdf8efdd018', '0dff47c0-cff9-4af2-864d-73c45573d434', '39646a3a-77fa-4fc4-aaf3-448111e87322'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:15:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Delete snapshot completed successfully. Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31c3ccc7-9d7e-455c-81d8-31f2a746064a tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-c496de84-e6a9-49e9-96a4-efa5b3b49ec7-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-quobyte-249a8072-bd47-4614-97d1-2ceb67bfdccb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "cinder-quobyte-249a8072-bd47-4614-97d1-2ceb67bfdccb" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbea68a-1d24-495c-8331-cf71baf003e7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:59 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb Jul 21 19:15:59 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "cinder-35a13da4-4366-49af-b943-b2e815bab55f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-35a13da4-4366-49af-b943-b2e815bab55f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:59 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:15:59 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb Jul 21 19:15:59 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3638d1-658a-4a8a-ad5a-aee7dd2d0114]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:15:59 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f Jul 21 19:15:59 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:15:59 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-249a8072-bd47-4614-97d1-2ceb67bfdccb" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:15:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "cinder-quobyte-249a8072-bd47-4614-97d1-2ceb67bfdccb" released by "delete_volume" :: held 1.005s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Created reservations ['94afc97f-9ff4-4436-825a-7e005af4236a', '6de6a96c-ec6d-42bd-b573-55d6dc36bfbb', 'e0712432-455b-4db4-97bb-b7ad900b51cc', '5cf03335-3dc3-4376-bda6-47767da893fa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:00 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:00 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:00 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:00 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f Jul 21 19:16:00 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:00 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Deleted volume successfully. Jul 21 19:16:00 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-35a13da4-4366-49af-b943-b2e815bab55f" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79069462-36f2-409b-b21a-b96e18420f3c tempest-VolumesActionsTest-814178139 None] Lock "cinder-249a8072-bd47-4614-97d1-2ceb67bfdccb-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-quobyte-35a13da4-4366-49af-b943-b2e815bab55f" released by "delete_volume" :: held 0.867s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Created reservations ['c0cfe632-7831-400a-a254-3c2c333b36a8', 'cd182a56-36ef-459d-8aa5-26da5419539e', '4af09141-e45d-4914-99a4-119863f96a2f', 'daa0a1e1-e672-4062-9ba2-fb736ef198fc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:00 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:00 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:01 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:01 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Deleted volume successfully. Jul 21 19:16:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ca91a30-13ab-42b9-bee7-7a4213bb52d4 tempest-SnapshotMetadataTestJSON-1431422453 None] Lock "cinder-35a13da4-4366-49af-b943-b2e815bab55f-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Flow 'volume_create_manager' (7b716ce3-a71b-4704-8efd-f10b5649998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c34205-0ec8-4b43-8509-ed4a01738170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c34205-0ec8-4b43-8509-ed4a01738170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1091417480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528ddb8c-e738-4c94-ac0b-e24e31d41c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd31dc70e2024b65b6333b529dce0668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:02Z,use_quota=True,user_id='ced68a55e7324667ad9353435d07eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d6f975-8bde-4138-becc-b34ecd81a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d6f975-8bde-4138-becc-b34ecd81a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9e9258-3397-4284-bda0-a8ef5e16ef88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9e9258-3397-4284-bda0-a8ef5e16ef88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '528ddb8c-e738-4c94-ac0b-e24e31d41c0a', 'volume_name': 'volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4bb749-3380-4aac-96e8-fe58cbb9670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4bb749-3380-4aac-96e8-fe58cbb9670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ae71b3-9551-4b46-896a-ffa126ed1309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:16:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Trying to clone 528ddb8c-e738-4c94-ac0b-e24e31d41c0a from image be5d1921-2dfc-4e84-8720-ad78553464c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:16:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:16:03 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:16:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34807069-d8b4-49fa-9341-dd24eb9b9d44]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:03 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD Jul 21 19:16:03 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 is fetched for user ced68a55e7324667ad9353435d07eb7e. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec77382b-76e4-4585-b111-c8ddbade222e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:04 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD Jul 21 19:16:04 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:04 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1091417480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528ddb8c-e738-4c94-ac0b-e24e31d41c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd31dc70e2024b65b6333b529dce0668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:02Z,use_quota=True,user_id='ced68a55e7324667ad9353435d07eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Creating volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:04 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1073741824 Jul 21 19:16:04 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1073741824" returned: 0 in 0.522s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a Jul 21 19:16:05 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:05 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Attempting download of be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[46916e90-522a-4d9f-949b-5d6c23900a6f]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:05 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm Jul 21 19:16:05 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (5e5610d4-8e49-433c-88c6-bcd814913962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f539f266-43be-4c19-aab9-0ad58959854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f539f266-43be-4c19-aab9-0ad58959854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-686005267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a2e4de-9724-4da4-8a84-23821901a27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:06Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a07440b-8fe6-4edd-a0c4-26552e5d67ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a07440b-8fe6-4edd-a0c4-26552e5d67ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c904df-5274-4867-b357-6f381383ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c904df-5274-4867-b357-6f381383ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a2e4de-9724-4da4-8a84-23821901a27c', 'volume_name': 'volume-f7a2e4de-9724-4da4-8a84-23821901a27c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166365ea-91bb-4aed-86e6-e663d54f7234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:06 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166365ea-91bb-4aed-86e6-e663d54f7234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cceca6-af68-452f-a72a-9ae9e7e8b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Volume f7a2e4de-9724-4da4-8a84-23821901a27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a2e4de-9724-4da4-8a84-23821901a27c', 'volume_size': 1} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-686005267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a2e4de-9724-4da4-8a84-23821901a27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:06Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Creating volume f7a2e4de-9724-4da4-8a84-23821901a27c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c 1073741824 Jul 21 19:16:06 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm Jul 21 19:16:06 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm" returned: 1 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_tp_r41wm' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec30594-0154-4cf2-bbf0-2ff22d86a11e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD Jul 21 19:16:06 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:06 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c 1073741824" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=132,cinder:SELECT=99,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:06 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c Jul 21 19:16:06 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] be5d1921-2dfc-4e84-8720-ad78553464c1 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:07 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a Jul 21 19:16:07 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:07 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cceca6-af68-452f-a72a-9ae9e7e8b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a2e4de-9724-4da4-8a84-23821901a27c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba11a1b6-cdac-4366-bd24-31991d3bc6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Volume volume-f7a2e4de-9724-4da4-8a84-23821901a27c (f7a2e4de-9724-4da4-8a84-23821901a27c): created successfully Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba11a1b6-cdac-4366-bd24-31991d3bc6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (5e5610d4-8e49-433c-88c6-bcd814913962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dc9f88dc-d45a-4c3a-bc2e-f833d074fb00 tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-f7a2e4de-9724-4da4-8a84-23821901a27c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-f7a2e4de-9724-4da4-8a84-23821901a27c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-quobyte-f7a2e4de-9724-4da4-8a84-23821901a27c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-f7a2e4de-9724-4da4-8a84-23821901a27c" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c91c8d-3bb4-4e84-a8c7-f8cd6269a10c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:08 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c Jul 21 19:16:08 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:09 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c Jul 21 19:16:09 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f7a2e4de-9724-4da4-8a84-23821901a27c" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-f7a2e4de-9724-4da4-8a84-23821901a27c" released by "delete_volume" :: held 0.917s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Created reservations ['c7b1158f-c620-4ed4-944b-3a8b7acc865e', '45edc126-1694-4928-940a-39470932098a', 'ef3e2c5c-02e9-4b19-822f-33dac2c67d01', '02f0643e-3de1-4c66-abfc-bddc3828a6d7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:09 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:09 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:09 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" returned: 0 in 2.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_po7rzdocdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:16:09 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Converted 112.00 MB image at 43.65 MB/s Jul 21 19:16:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:09 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1G Jul 21 19:16:09 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:10 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 1G" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Downloaded image be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 for user ced68a55e7324667ad9353435d07eb7e is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Marking volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Copying metadata from image be5d1921-2dfc-4e84-8720-ad78553464c1 to 528ddb8c-e738-4c94-ac0b-e24e31d41c0a. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Creating volume glance metadata for volume 528ddb8c-e738-4c94-ac0b-e24e31d41c0a backed by image be5d1921-2dfc-4e84-8720-ad78553464c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:16:10 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.659s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Deleted volume successfully. Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-49766232-5eae-4b76-b2cd-66ca0fda2f15 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-f7a2e4de-9724-4da4-8a84-23821901a27c-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ae71b3-9551-4b46-896a-ffa126ed1309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaea5a9-560e-4fa2-a70a-e2ce1cb1b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Volume volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a (528ddb8c-e738-4c94-ac0b-e24e31d41c0a): created successfully Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaea5a9-560e-4fa2-a70a-e2ce1cb1b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Flow 'volume_create_manager' (7b716ce3-a71b-4704-8efd-f10b5649998e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d339f02a-9092-48e4-adab-c745edf3c691 tempest-VolumesExtendTest-1818594952 None] Created volume successfully. Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (a572c0ce-7fb6-4027-8d20-6e5363fec5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c5922c-174e-44d8-94e5-ee66f734c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c5922c-174e-44d8-94e5-ee66f734c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640099695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffb47ad-c92f-4f4a-bcf6-b7c64a92d304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:11Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28421a8d-903f-4f48-9aa2-8929186a6735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28421a8d-903f-4f48-9aa2-8929186a6735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6359ede-208b-4ab2-b756-ace93d2f1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6359ede-208b-4ab2-b756-ace93d2f1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bffb47ad-c92f-4f4a-bcf6-b7c64a92d304', 'volume_name': 'volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4168ceb6-2b08-499a-aed3-0d4e87e22162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4168ceb6-2b08-499a-aed3-0d4e87e22162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e215f-e248-4627-8068-9bedfe28fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Volume bffb47ad-c92f-4f4a-bcf6-b7c64a92d304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304', 'volume_size': 1} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640099695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bffb47ad-c92f-4f4a-bcf6-b7c64a92d304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:11Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Creating volume bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:10 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 1073741824 Jul 21 19:16:10 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:11 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 1073741824" returned: 0 in 0.614s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:11 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 Jul 21 19:16:11 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:11 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.462s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8e215f-e248-4627-8068-9bedfe28fd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299ec8c-71e7-4dba-8377-0af5b36c8d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b3d99-3bd0-4580-8668-23ee93003c53]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Volume volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 (bffb47ad-c92f-4f4a-bcf6-b7c64a92d304): created successfully Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3299ec8c-71e7-4dba-8377-0af5b36c8d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (a572c0ce-7fb6-4027-8d20-6e5363fec5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b0290f65-a917-4bdb-879b-360854f26ccb tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:16:12 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a Jul 21 19:16:12 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:12 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a 2G" returned: 0 in 0.182s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.676s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-359f2f20-5648-4d3a-8b04-5d81784c6e0d tempest-VolumesExtendTest-1818594952 None] Extend volume completed successfully. Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-quobyte-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba801cc4-20e6-4f32-851e-bd4c0c13261d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:13 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 Jul 21 19:16:13 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:13 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" returned: 0 in 0.602s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-528ddb8c-e738-4c94-ac0b-e24e31d41c0a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:14 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304 Jul 21 19:16:14 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "cinder-528ddb8c-e738-4c94-ac0b-e24e31d41c0a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-quobyte-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e80d00-aedf-47b0-b697-86994602ac61]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:14 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a Jul 21 19:16:14 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:14 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304" released by "delete_volume" :: held 1.144s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Created reservations ['872f1c8b-cc2a-401b-b0cd-df71551d9638', '66b0fa6b-4721-4670-877e-f0c61435eabf', 'fe3e9264-70a6-4da3-b497-6f316d0c7ee0', 'dfaa3b4a-5fb9-4c07-898a-aa84c771995a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:14 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:14 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:14 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" returned: 0 in 0.650s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:14 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a Jul 21 19:16:14 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:15 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Deleted volume successfully. Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-380dba13-849f-47f5-8578-5e0a9da55b61 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-bffb47ad-c92f-4f4a-bcf6-b7c64a92d304-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:15 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-528ddb8c-e738-4c94-ac0b-e24e31d41c0a" released by "delete_volume" :: held 1.088s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Created reservations ['535e1078-ac7c-4159-a98f-ed30b4bf7585', '4cd22e48-1789-4cc7-88a0-55e49ced2c6f', 'b57f32a5-8a5a-4c00-aee4-a61c528941e7', '80f66523-809e-488f-8805-9cb12ba73257'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:15 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:15 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:15 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Deleted volume successfully. Jul 21 19:16:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25f77ffd-78d2-468d-9eab-c87faf6570ed tempest-VolumesExtendTest-1818594952 None] Lock "cinder-528ddb8c-e738-4c94-ac0b-e24e31d41c0a-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (7a2fcc8c-65c9-49d8-9e18-84d78a2b9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d1a84f-888f-463c-84f5-cec0e501e17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d1a84f-888f-463c-84f5-cec0e501e17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961353511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3deb63-bc40-4941-a4f8-f9deb3b4f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2314d18d-416c-443c-a07e-5fa6fa610408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2314d18d-416c-443c-a07e-5fa6fa610408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa1cdf4-9053-4d97-b6b2-8bdbd2b630fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa1cdf4-9053-4d97-b6b2-8bdbd2b630fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3deb63-bc40-4941-a4f8-f9deb3b4f768', 'volume_name': 'volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f7a04-acda-45bf-92c7-5ac20f77207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f7a04-acda-45bf-92c7-5ac20f77207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6583a5-6cbf-4d27-bd08-9a4daf487398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Volume dc3deb63-bc40-4941-a4f8-f9deb3b4f768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768', 'volume_size': 1} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961353511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3deb63-bc40-4941-a4f8-f9deb3b4f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:16Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Creating volume dc3deb63-bc40-4941-a4f8-f9deb3b4f768 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:16 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:16 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 1073741824 Jul 21 19:16:16 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:17 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Flow 'volume_create_manager' (9ac0e87b-c130-4506-876d-82207d61327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc39319-e5bd-4781-8995-b12733ecec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 1073741824" returned: 0 in 0.951s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc39319-e5bd-4781-8995-b12733ecec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1310368648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6075b946-410c-443a-8e29-1335a0c03bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd31dc70e2024b65b6333b529dce0668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='ced68a55e7324667ad9353435d07eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ac1144-badf-4db0-a374-726f74a9b524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ac1144-badf-4db0-a374-726f74a9b524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33528d68-c4ad-4742-b5d1-ef73ab3d4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33528d68-c4ad-4742-b5d1-ef73ab3d4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6075b946-410c-443a-8e29-1335a0c03bdb', 'volume_name': 'volume-6075b946-410c-443a-8e29-1335a0c03bdb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06a6166-69a6-44a1-92b9-df1c7e967933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06a6166-69a6-44a1-92b9-df1c7e967933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a86fb-83f3-4311-881e-a8275833fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Volume 6075b946-410c-443a-8e29-1335a0c03bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6075b946-410c-443a-8e29-1335a0c03bdb', 'volume_size': 1} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:17 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 Jul 21 19:16:17 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:17 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1310368648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6075b946-410c-443a-8e29-1335a0c03bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd31dc70e2024b65b6333b529dce0668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:17Z,use_quota=True,user_id='ced68a55e7324667ad9353435d07eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Creating volume 6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:17 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6583a5-6cbf-4d27-bd08-9a4daf487398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:18 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb 1073741824 Jul 21 19:16:18 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7527181b-efef-4261-bbdf-c44709db8ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Volume volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 (dc3deb63-bc40-4941-a4f8-f9deb3b4f768): created successfully Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7527181b-efef-4261-bbdf-c44709db8ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (7a2fcc8c-65c9-49d8-9e18-84d78a2b9d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cebd4f0b-cc75-4f31-b923-b74c4120cca5 tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:16:18 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb 1073741824" returned: 0 in 0.649s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:18 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:18 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-dc3deb63-bc40-4941-a4f8-f9deb3b4f768-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-dc3deb63-bc40-4941-a4f8-f9deb3b4f768-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-quobyte-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd41111-e572-4d17-be04-95bd4fe97832]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:19 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967a86fb-83f3-4311-881e-a8275833fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6075b946-410c-443a-8e29-1335a0c03bdb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:19 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 Jul 21 19:16:19 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569e14d8-463f-4004-966d-e09c61ca2d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Volume volume-6075b946-410c-443a-8e29-1335a0c03bdb (6075b946-410c-443a-8e29-1335a0c03bdb): created successfully Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569e14d8-463f-4004-966d-e09c61ca2d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Flow 'volume_create_manager' (9ac0e87b-c130-4506-876d-82207d61327f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-85a57aee-4ff0-447b-83aa-19d293454ac1 tempest-VolumesExtendTest-1818594952 None] Created volume successfully. Jul 21 19:16:19 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" returned: 0 in 0.670s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:19 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768 Jul 21 19:16:19 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:19 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-dc3deb63-bc40-4941-a4f8-f9deb3b4f768" released by "delete_volume" :: held 1.051s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Created reservations ['10e7c61d-2f4a-4415-b73b-03aebabe04fc', '4943c53c-c08d-4676-9517-866b301c51c5', '70d3f20d-e16f-4aaa-96a9-3138e2a0cb90', 'bdffe94b-9526-4f4d-a335-c66dad0aa184'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:20 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:20 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:20 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Deleted volume successfully. Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c461751-9c62-4f73-8e20-fa9e9bcdd5e8 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-dc3deb63-bc40-4941-a4f8-f9deb3b4f768-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Creating offline snapshot e109df85-be8b-4cd7-9835-aef47f86b64b of volume 6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9128af-8509-4353-a3aa-112eb3047dc0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:20 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:20 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:21 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:21 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b 1G Jul 21 19:16:21 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:21 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b 1G" returned: 0 in 0.686s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6075b946-410c-443a-8e29-1335a0c03bdb -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:21 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6075b946-410c-443a-8e29-1335a0c03bdb -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b Jul 21 19:16:21 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (f6f67a1c-0cfe-4c4c-abd2-ae0ecaae9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34aa01cd-845d-4e22-927b-cb6c7a694a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34aa01cd-845d-4e22-927b-cb6c7a694a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810472000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:22Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd94dd6-ecff-446b-b79d-53815167efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd94dd6-ecff-446b-b79d-53815167efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c418d-6f8d-45b0-918f-1b7e806cf59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c418d-6f8d-45b0-918f-1b7e806cf59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b', 'volume_name': 'volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fc7c6e-7075-4e28-ab13-da1d4c5457eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fc7c6e-7075-4e28-ab13-da1d4c5457eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d927f8-2e7e-498c-8916-b613d162c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Volume 2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b', 'volume_size': 1} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:22 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6075b946-410c-443a-8e29-1335a0c03bdb -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b is being set with open permissions: ugo+rw Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:22 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b Jul 21 19:16:22 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:22 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:22 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info Jul 21 19:16:22 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:23 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info is being set with open permissions: ugo+rw Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:23 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info Jul 21 19:16:23 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Flow 'volume_create_manager' (a4ccb995-1e51-439d-b913-7d956899b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e3e814-7add-4be9-ac37-686f8c579708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e3e814-7add-4be9-ac37-686f8c579708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765697939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c571fb75ebd34005a10e52243beb0a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:23Z,use_quota=True,user_id='9b45d14b9f0b424ca81b7fb574d83cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fa3cd9-1184-4c46-b675-c2454c473041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fa3cd9-1184-4c46-b675-c2454c473041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195972bb-da1a-4c95-b767-94ce0d647818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195972bb-da1a-4c95-b767-94ce0d647818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6', 'volume_name': 'volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee50d4b-acb7-40b4-b407-7c287aeccf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee50d4b-acb7-40b4-b407-7c287aeccf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b06e066-3b38-4802-af1d-ead453827241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6', 'volume_size': 1} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:23 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.info" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1810472000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:22Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Creating volume 2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e9e14d7-1076-407b-9189-1eef99454e02 tempest-VolumesExtendTest-1818594952 None] Create snapshot completed successfully Jul 21 19:16:23 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b 1073741824 Jul 21 19:16:23 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:24 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b 1073741824" returned: 0 in 0.648s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b Jul 21 19:16:24 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765697939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c571fb75ebd34005a10e52243beb0a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:23Z,use_quota=True,user_id='9b45d14b9f0b424ca81b7fb574d83cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Creating volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d927f8-2e7e-498c-8916-b613d162c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:24 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 1073741824 Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc6c3e9-e837-432a-9930-0df5d1a59fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:24 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Volume volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b (2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b): created successfully Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc6c3e9-e837-432a-9930-0df5d1a59fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (f6f67a1c-0cfe-4c4c-abd2-ae0ecaae9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8be326c-503a-41a9-8390-2db57641614e tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:16:25 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 1073741824" returned: 0 in 0.658s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:25 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:16:25 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "cinder-quobyte-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:25 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.756s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a5af3-4eb7-47fb-81cf-db2886b1c31a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be50ce6-3bfe-4f03-9797-214c5cde1d74]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b06e066-3b38-4802-af1d-ead453827241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1455c7-e7bf-4155-82b6-074ab359face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Volume volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 (5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6): created successfully Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1455c7-e7bf-4155-82b6-074ab359face) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Flow 'volume_create_manager' (a4ccb995-1e51-439d-b913-7d956899b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3be00028-5eeb-4619-b19e-0a52104b7741 tempest-VolumesActionsTest-826648911 None] Created volume successfully. Jul 21 19:16:25 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b Jul 21 19:16:25 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:25 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:25 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:26 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:26 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b Jul 21 19:16:26 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:26 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b 2G" returned: 0 in 0.189s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.704s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0c90caa4-e8a6-4253-8ba4-315455439d89 tempest-VolumesExtendTest-1818594952 None] Extend volume completed successfully. Jul 21 19:16:26 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-quobyte-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b" released by "delete_volume" :: held 0.845s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Created reservations ['d6a6a9dd-fc98-4a05-a23a-c28e3bdd1e48', 'f8e238a6-25f3-403c-8cc0-9c79fb9f1b98', '13847281-974e-43d1-bdbc-a276d5034104', '49e5daca-8f39-49ef-87de-f323fb9c004a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:26 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:26 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:27 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Deleted volume successfully. Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bdeed15-8d09-4f38-8ff4-1656bd06c935 tempest-VolumesActionsTest-1098235997 None] Lock "cinder-2c577a24-ecf3-4bcb-bbb4-1e4cd2a7b60b-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-e109df85-be8b-4cd7-9835-aef47f86b64b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-e109df85-be8b-4cd7-9835-aef47f86b64b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-quobyte-e109df85-be8b-4cd7-9835-aef47f86b64b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-e109df85-be8b-4cd7-9835-aef47f86b64b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Deleting offline snapshot e109df85-be8b-4cd7-9835-aef47f86b64b of volume 6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] snapshot_file for this snap is: volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f00dca-ec63-420a-9267-a258075279d6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:27 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b Jul 21 19:16:27 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:28 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b" returned: 0 in 0.505s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6075b946-410c-443a-8e29-1335a0c03bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9052611-738a-46c4-891c-0c65bd8c1df4]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:28 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:28 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (b75a6326-dd65-482b-bb2c-480486810278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:28 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8698239a-3ca2-4d6e-8ef0-8fea68cec3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8698239a-3ca2-4d6e-8ef0-8fea68cec3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300831305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:29Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a913c6-c9af-43cc-b231-bb57ed3deb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a913c6-c9af-43cc-b231-bb57ed3deb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b Jul 21 19:16:28 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73994e9e-2bc2-4e9e-944b-5c2ea72ae9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73994e9e-2bc2-4e9e-944b-5c2ea72ae9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27', 'volume_name': 'volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efc0b64-b656-435a-9cdb-73b6fa0577c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8efc0b64-b656-435a-9cdb-73b6fa0577c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb5dd42-56fa-4119-9fce-aefd19b61ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Volume cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27', 'volume_size': 1} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300831305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c92af99f64438bb32230fcfb578cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:29Z,use_quota=True,user_id='ebee42519783498ba60b4eaa28f58f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Creating volume cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:28 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 1073741824 Jul 21 19:16:28 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b" returned: 0 in 0.615s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:29 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b Jul 21 19:16:29 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 1073741824" returned: 0 in 0.811s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:29 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 Jul 21 19:16:29 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:29 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Flow 'volume_create_manager' (569d1974-b986-47c0-965b-22ca04b6f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b640c48b-530c-41a7-b7a7-31d10afeb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb.e109df85-be8b-4cd7-9835-aef47f86b64b" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-e109df85-be8b-4cd7-9835-aef47f86b64b" released by "_delete_snapshot" :: held 2.385s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b640c48b-530c-41a7-b7a7-31d10afeb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1183291170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3fde60-572a-4e1e-9f11-12d797fac88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961f038ee77f4926afe4fd4729c3416a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:30Z,use_quota=True,user_id='6172e8b92079412b9b1ecffd4192d398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6266d18-2bf9-4615-8223-07c0e1ccb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6266d18-2bf9-4615-8223-07c0e1ccb263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754e6b51-2c2c-4ea0-acd4-5b6dc7d56802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754e6b51-2c2c-4ea0-acd4-5b6dc7d56802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3fde60-572a-4e1e-9f11-12d797fac88c', 'volume_name': 'volume-fd3fde60-572a-4e1e-9f11-12d797fac88c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e03195f-bdd8-4eaa-9199-a5ef0fcdfe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e03195f-bdd8-4eaa-9199-a5ef0fcdfe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c8f507-d542-4ea4-8304-76c743022232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Volume fd3fde60-572a-4e1e-9f11-12d797fac88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3fde60-572a-4e1e-9f11-12d797fac88c', 'volume_size': 1} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" released by "delete_snapshot" :: held 2.512s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:30 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1183291170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3fde60-572a-4e1e-9f11-12d797fac88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961f038ee77f4926afe4fd4729c3416a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:30Z,use_quota=True,user_id='6172e8b92079412b9b1ecffd4192d398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Creating volume fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:30 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Created reservations ['705e6284-243c-4a6d-a981-e1bbb19ed094', '24ed3989-b9e4-406b-9912-7cf287759779', '816b3689-4b70-4c3e-b2f5-175451834b9b', '0777c9a7-d734-4de4-a455-415f987ae5d1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb5dd42-56fa-4119-9fce-aefd19b61ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:30 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c 1073741824 Jul 21 19:16:30 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbccad0e-bff4-499f-a060-b9346554b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Volume volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 (cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27): created successfully Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbccad0e-bff4-499f-a060-b9346554b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Flow 'volume_create_manager' (b75a6326-dd65-482b-bb2c-480486810278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-390dea4f-c499-458e-8987-0838a98baeac tempest-VolumesActionsTest-814178139 None] Created volume successfully. Jul 21 19:16:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Delete snapshot completed successfully. Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee81a54f-23fe-451d-b6ba-eca2b1a35438 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-e109df85-be8b-4cd7-9835-aef47f86b64b-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:30 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c 1073741824" returned: 0 in 0.697s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-6075b946-410c-443a-8e29-1335a0c03bdb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-6075b946-410c-443a-8e29-1335a0c03bdb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:30 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:16:30 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" acquired by "delete_volume" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5998c49-58bf-4cc4-b82d-739f2a4bb519]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:31 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:31 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c8f507-d542-4ea4-8304-76c743022232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3fde60-572a-4e1e-9f11-12d797fac88c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18307f95-7362-4917-8376-fbc285af30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Volume volume-fd3fde60-572a-4e1e-9f11-12d797fac88c (fd3fde60-572a-4e1e-9f11-12d797fac88c): created successfully Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18307f95-7362-4917-8376-fbc285af30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Flow 'volume_create_manager' (569d1974-b986-47c0-965b-22ca04b6f537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c2294c68-c7e0-4836-8f98-063522524d02 tempest-TestStampPattern-2099318761 None] Created volume successfully. Jul 21 19:16:31 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:31 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb Jul 21 19:16:31 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "cinder-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Acquiring lock "cinder-quobyte-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "cinder-quobyte-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bfec31-b04b-4c40-9e32-b71001e04b1c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:32 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6075b946-410c-443a-8e29-1335a0c03bdb" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-quobyte-6075b946-410c-443a-8e29-1335a0c03bdb" released by "delete_volume" :: held 1.019s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:32 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 Jul 21 19:16:32 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Created reservations ['e2cf8598-9891-420a-bd12-a1818c874010', 'bb2e0349-6b96-4612-bcd5-fd37208d5b34', 'cfdb7487-6104-4a67-9c48-bf1155b11baf', 'f03cb492-ca96-484d-b204-e0df06fa92af'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:32 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:32 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:32 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" returned: 0 in 0.694s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:32 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27 Jul 21 19:16:32 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:32 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Deleted volume successfully. Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52af2717-cd6e-4dce-83bf-4d6130361052 tempest-VolumesExtendTest-1818594952 None] Lock "cinder-6075b946-410c-443a-8e29-1335a0c03bdb-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:32 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "cinder-quobyte-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27" released by "delete_volume" :: held 1.077s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Created reservations ['354fbebe-104a-46d6-86df-2fecb19c5df2', 'a50893ed-b2b6-4b7f-baf3-6d89d7a9c6f6', 'd6894339-aa2f-4b09-a856-ad2468d512d8', '89cf44e5-0829-4d36-a4d1-b24d7bcc2273'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:33 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:16:33 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:33 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.610s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:16:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Deleted volume successfully. Jul 21 19:16:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7a80271-dd4b-49ee-9591-dc3dd2886dbd tempest-VolumesActionsTest-814178139 None] Lock "cinder-cb98bfe0-88ba-4dd2-9fa2-a9d3eb8d4f27-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fa85e91-cc39-4d86-93f3-c83575125c97 tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fa85e91-cc39-4d86-93f3-c83575125c97 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" acquired by "attach_volume" :: waited 0.070s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9fa85e91-cc39-4d86-93f3-c83575125c97 tempest-VolumesActionsTest-826648911 None] Attaching volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 to instance 57940a2a-2997-4ba1-af53-883fa817e3c1 at mountpoint /dev/vdb on host None. Jul 21 19:16:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9fa85e91-cc39-4d86-93f3-c83575125c97 tempest-VolumesActionsTest-826648911 None] Attach volume completed successfully. Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fa85e91-cc39-4d86-93f3-c83575125c97 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" released by "attach_volume" :: held 0.265s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9adc922-8392-4290-b953-bf3737d939f5 tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9adc922-8392-4290-b953-bf3737d939f5 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c9adc922-8392-4290-b953-bf3737d939f5 tempest-VolumesActionsTest-826648911 None] Detaching volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 from instance 57940a2a-2997-4ba1-af53-883fa817e3c1. Jul 21 19:16:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c9adc922-8392-4290-b953-bf3737d939f5 tempest-VolumesActionsTest-826648911 None] Detach volume completed successfully. Jul 21 19:16:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c9adc922-8392-4290-b953-bf3737d939f5 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Flow 'volume_create_manager' (386e4f70-b39a-4e2c-8d31-bd52ba787419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ee824f-a51d-4274-aac2-35840424f374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ee824f-a51d-4274-aac2-35840424f374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-697686309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c57f7c3-d80e-4417-9087-0ec2aafec932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d43bcf051b44a5981391e97b1194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:46Z,use_quota=True,user_id='3f519e65cf694e23ae6f7d23eea0e355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd9c0d-1154-4970-a29a-1b118545ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd9c0d-1154-4970-a29a-1b118545ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e9671-f0e4-45e7-a1e6-dcec8d0f65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0e9671-f0e4-45e7-a1e6-dcec8d0f65cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c57f7c3-d80e-4417-9087-0ec2aafec932', 'volume_name': 'volume-7c57f7c3-d80e-4417-9087-0ec2aafec932', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e0f6a-ab07-4312-9dbf-72b92cdefad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e0f6a-ab07-4312-9dbf-72b92cdefad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56180d2-be6c-4d76-b28a-c678db6bae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Volume 7c57f7c3-d80e-4417-9087-0ec2aafec932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c57f7c3-d80e-4417-9087-0ec2aafec932', 'volume_size': 1} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-697686309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c57f7c3-d80e-4417-9087-0ec2aafec932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d43bcf051b44a5981391e97b1194b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:16:46Z,use_quota=True,user_id='3f519e65cf694e23ae6f7d23eea0e355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Creating volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:16:46 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:16:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:46 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 1073741824 Jul 21 19:16:46 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:47 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 1073741824" returned: 0 in 0.610s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:47 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 Jul 21 19:16:47 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:47 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56180d2-be6c-4d76-b28a-c678db6bae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c57f7c3-d80e-4417-9087-0ec2aafec932', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25ea7c-592b-4500-8cd3-e757cf499120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:16:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Volume volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 (7c57f7c3-d80e-4417-9087-0ec2aafec932): created successfully Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25ea7c-592b-4500-8cd3-e757cf499120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:16:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Flow 'volume_create_manager' (386e4f70-b39a-4e2c-8d31-bd52ba787419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:16:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fdfe0873-2420-444c-9be7-af1435622d24 tempest-VolumesSnapshotListTestJSON-1792793757 None] Created volume successfully. Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Creating offline snapshot 1e9f2e3a-adcb-4839-94cf-11f87c7a6824 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[185bede1-614d-4db8-9871-122b35c32c47]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:49 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 Jul 21 19:16:49 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:49 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932" returned: 0 in 0.661s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:49 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 1G Jul 21 19:16:49 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:50 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 1G" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:50 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:16:50 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:51 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.761s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:51 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 is being set with open permissions: ugo+rw Jul 21 19:16:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:51 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:16:51 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:51 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:51 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=143,cinder:INSERT=46,cinder:DELETE=16,cinder:SELECT=111 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:16:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:51 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info Jul 21 19:16:51 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info is being set with open permissions: ugo+rw Jul 21 19:16:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:52 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info Jul 21 19:16:52 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:52 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.info" returned: 0 in 0.514s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.772s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d0882789-1282-405c-baca-9b2d758480f8 tempest-VolumesSnapshotListTestJSON-1792793757 None] Create snapshot completed successfully Jul 21 19:16:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Creating offline snapshot 38327fcf-cbff-4b2e-9f39-77cc090a1e60 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81780287-14a4-44d4-b1b5-f99b1e629413]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:53 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:16:53 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.670s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:54 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 1G Jul 21 19:16:54 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:54 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 1G" returned: 0 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:54 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:16:54 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 is being set with open permissions: ugo+rw Jul 21 19:16:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:55 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:16:55 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:55 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0a9575be-970b-4b59-bff1-0c8db39c2475 tempest-VolumesSnapshotListTestJSON-1792793757 None] Create snapshot completed successfully Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Creating offline snapshot 1c15e7ab-64f9-40fd-9300-f1387d093731 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[68417439-faa6-412b-91a5-2594f9f1d502]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:57 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:16:57 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:57 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.610s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:16:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:57 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 1G Jul 21 19:16:57 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:58 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 1G" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:58 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 Jul 21 19:16:58 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:58 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:58 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 is being set with open permissions: ugo+rw Jul 21 19:16:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:16:58 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 Jul 21 19:16:58 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9e70099-edb9-4902-a07b-32c117b08a23 tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9e70099-edb9-4902-a07b-32c117b08a23 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" acquired by "attach_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9e70099-edb9-4902-a07b-32c117b08a23 tempest-VolumesActionsTest-826648911 None] Attaching volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 to instance 3ef06855-aad1-426e-9420-417cd13d40c2 at mountpoint /dev/vdb on host None. Jul 21 19:16:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9e70099-edb9-4902-a07b-32c117b08a23 tempest-VolumesActionsTest-826648911 None] Attach volume completed successfully. Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9e70099-edb9-4902-a07b-32c117b08a23 tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" released by "attach_volume" :: held 0.141s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:16:59 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:16:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7772ca64-15a7-43e5-a5a9-34a36d9e8864 tempest-VolumesSnapshotListTestJSON-1792793757 None] Create snapshot completed successfully Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29e0b1a7-6e2e-484a-8936-7da37caad16a tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29e0b1a7-6e2e-484a-8936-7da37caad16a tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:16:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-29e0b1a7-6e2e-484a-8936-7da37caad16a tempest-VolumesActionsTest-826648911 None] Detaching volume 5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 from instance 3ef06855-aad1-426e-9420-417cd13d40c2. Jul 21 19:16:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-29e0b1a7-6e2e-484a-8936-7da37caad16a tempest-VolumesActionsTest-826648911 None] Detach volume completed successfully. Jul 21 19:16:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29e0b1a7-6e2e-484a-8936-7da37caad16a tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Flow 'volume_create_manager' (2f10ad0b-82c6-49a4-aff8-5e9f6686adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d445310-69ab-4997-bf66-61727d744cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d445310-69ab-4997-bf66-61727d744cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-835671066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944dfd00-71d2-44da-bee0-00b9a934c5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887134ed70ad438ab7d0abbf2b40fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:01Z,use_quota=True,user_id='67f8e13b8f0740aeba093f50e0a789ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcd5f00-2553-4af1-b53a-1a09cd663c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efcd5f00-2553-4af1-b53a-1a09cd663c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891a4b70-3cfe-4179-88f4-44ff778d207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891a4b70-3cfe-4179-88f4-44ff778d207b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944dfd00-71d2-44da-bee0-00b9a934c5fd', 'volume_name': 'volume-944dfd00-71d2-44da-bee0-00b9a934c5fd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586def90-0520-40ed-a2f4-4cfe0ec4b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586def90-0520-40ed-a2f4-4cfe0ec4b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298e4f7e-e7f0-4ebe-991c-5468d683a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Volume 944dfd00-71d2-44da-bee0-00b9a934c5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944dfd00-71d2-44da-bee0-00b9a934c5fd', 'volume_size': 1} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-835671066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944dfd00-71d2-44da-bee0-00b9a934c5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887134ed70ad438ab7d0abbf2b40fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:01Z,use_quota=True,user_id='67f8e13b8f0740aeba093f50e0a789ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Creating volume 944dfd00-71d2-44da-bee0-00b9a934c5fd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:01 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd 1073741824 Jul 21 19:17:01 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:01 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-1c15e7ab-64f9-40fd-9300-f1387d093731-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd 1073741824" returned: 0 in 0.838s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-1c15e7ab-64f9-40fd-9300-f1387d093731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-1c15e7ab-64f9-40fd-9300-f1387d093731" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-1c15e7ab-64f9-40fd-9300-f1387d093731" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Deleting offline snapshot 1c15e7ab-64f9-40fd-9300-f1387d093731 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:01 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd Jul 21 19:17:01 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] snapshot_file for this snap is: volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed2034-9e75-47e4-a935-3f18c9ff69ff]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:02 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 Jul 21 19:17:02 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:02 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298e4f7e-e7f0-4ebe-991c-5468d683a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944dfd00-71d2-44da-bee0-00b9a934c5fd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c907eeed-6673-4824-9081-c288d13c1abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Volume volume-944dfd00-71d2-44da-bee0-00b9a934c5fd (944dfd00-71d2-44da-bee0-00b9a934c5fd): created successfully Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c907eeed-6673-4824-9081-c288d13c1abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Flow 'volume_create_manager' (2f10ad0b-82c6-49a4-aff8-5e9f6686adf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba741667-b776-4ae4-a00b-d5081f4360a7 tempest-VolumesTransfersTest-1224655999 None] Created volume successfully. Jul 21 19:17:02 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1e791-588c-4d90-969a-c72c81332756]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:02 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:17:02 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:02 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:02 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 Jul 21 19:17:02 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:03 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731" returned: 0 in 0.571s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:03 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731 Jul 21 19:17:03 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aed5103f-1477-45aa-9a3f-f2e1f9e70a2e tempest-VolumesTransfersTest-1986519403 None] Transfer volume completed successfully. Jul 21 19:17:03 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1c15e7ab-64f9-40fd-9300-f1387d093731" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-1c15e7ab-64f9-40fd-9300-f1387d093731" released by "_delete_snapshot" :: held 1.875s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" released by "delete_snapshot" :: held 1.929s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Created reservations ['3926069b-8294-49a6-b988-3a99d07d5616', 'c7e41f25-1e08-4ace-8ac8-8a69e46b6431', 'c781b68c-7e87-40a2-aa18-beaba3fd6889', 'dddafeb0-2b2a-44de-af0b-3e0a5908e8c8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Delete snapshot completed successfully. Jul 21 19:17:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e77380a7-ee18-4ef6-b0cc-6f597efda2c6 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-1c15e7ab-64f9-40fd-9300-f1387d093731-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-38327fcf-cbff-4b2e-9f39-77cc090a1e60-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-38327fcf-cbff-4b2e-9f39-77cc090a1e60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-38327fcf-cbff-4b2e-9f39-77cc090a1e60" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-38327fcf-cbff-4b2e-9f39-77cc090a1e60" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Deleting offline snapshot 38327fcf-cbff-4b2e-9f39-77cc090a1e60 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] snapshot_file for this snap is: volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d57bee-6dcd-4ebc-a911-d7615e20d9e0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:17:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "cinder-944dfd00-71d2-44da-bee0-00b9a934c5fd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-944dfd00-71d2-44da-bee0-00b9a934c5fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "cinder-quobyte-944dfd00-71d2-44da-bee0-00b9a934c5fd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-quobyte-944dfd00-71d2-44da-bee0-00b9a934c5fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f56b1-7fd1-4eec-b482-678878d60b37]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:04 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd Jul 21 19:17:04 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8704f28d-c635-47f0-9863-3afb64523dce]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:17:04 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d627d2-82c5-43e0-b127-52917c517ccd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:04 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd Jul 21 19:17:04 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:04 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:05 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:17:05 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-944dfd00-71d2-44da-bee0-00b9a934c5fd" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-quobyte-944dfd00-71d2-44da-bee0-00b9a934c5fd" released by "delete_volume" :: held 0.816s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Created reservations ['5b7b1237-2589-4fa4-883b-a010c6fb859c', '5dd71a85-12ce-4e63-9c32-656bcf0cab11', 'f8643846-1425-49dc-9888-0f5eedccc564', '82f30e41-d3b2-4457-bb71-6012248206bd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:05 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588fbe0-e42d-4c04-beb1-5213ec28055a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:05 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:05 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a45ed819-7168-4b4a-ad5c-885081db38e4 req-17079d40-0f58-4585-ab35-0b2a9ae7ab05 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:05 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60 Jul 21 19:17:05 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:05 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Deleted volume successfully. Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-592bcd6e-d50c-4c04-850d-13d07a2c6288 tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-944dfd00-71d2-44da-bee0-00b9a934c5fd-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:05 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.4ce01c7b-49bc-40ad-9f6f-9e2390ea3ccazm9tf4p4.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:05 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.4ce01c7b-49bc-40ad-9f6f-9e2390ea3ccazm9tf4p4.img Jul 21 19:17:05 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:06 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.38327fcf-cbff-4b2e-9f39-77cc090a1e60" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-38327fcf-cbff-4b2e-9f39-77cc090a1e60" released by "_delete_snapshot" :: held 2.003s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" released by "delete_snapshot" :: held 2.030s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Created reservations ['70911313-e07e-4bfb-95e4-0e5563227d03', 'ed0ea807-f394-489b-acaf-e770f556c226', '4a40c08a-350a-4d0c-9612-a854ff86a476', '4503a644-9b54-435c-9771-95edb5a51b30'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Flow 'volume_create_manager' (39ddef7d-7cc1-4904-9347-93ca4ecbafaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b332ee3-2331-43fd-9583-0dc87385d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b332ee3-2331-43fd-9583-0dc87385d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-155034375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfb86dc-10ec-4879-9a9a-69b1eef02f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887134ed70ad438ab7d0abbf2b40fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:06Z,use_quota=True,user_id='67f8e13b8f0740aeba093f50e0a789ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc1d26e-9322-49f0-9535-0fd6240f27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc1d26e-9322-49f0-9535-0fd6240f27fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7c7b7-0ebf-4329-a843-0474357268e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead7c7b7-0ebf-4329-a843-0474357268e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfb86dc-10ec-4879-9a9a-69b1eef02f25', 'volume_name': 'volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3c88a5-2c23-4ac0-9178-1275a1b0f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3c88a5-2c23-4ac0-9178-1275a1b0f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be042145-9653-48c5-9222-d4c2d0411f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Volume 6bfb86dc-10ec-4879-9a9a-69b1eef02f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25', 'volume_size': 1} Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Delete snapshot completed successfully. Jul 21 19:17:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17461efa-9bcf-4a81-b8a4-fa29fe485709 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-38327fcf-cbff-4b2e-9f39-77cc090a1e60-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-1e9f2e3a-adcb-4839-94cf-11f87c7a6824-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-1e9f2e3a-adcb-4839-94cf-11f87c7a6824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-1e9f2e3a-adcb-4839-94cf-11f87c7a6824" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-1e9f2e3a-adcb-4839-94cf-11f87c7a6824" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Deleting offline snapshot 1e9f2e3a-adcb-4839-94cf-11f87c7a6824 of volume 7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] snapshot_file for this snap is: volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33a9ef0-23cd-437a-a205-470b0dd5638c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:07 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:17:07 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:08 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.678s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c57f7c3-d80e-4417-9087-0ec2aafec932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70dff83-c5b8-4cfe-b87c-d0997cbe5430]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:08 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 Jul 21 19:17:08 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:09 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932" returned: 0 in 0.769s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:09 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:17:09 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:09 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.725s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:10 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824 Jul 21 19:17:10 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:10 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.4ce01c7b-49bc-40ad-9f6f-9e2390ea3ccazm9tf4p4.img" returned: 0 in 4.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae235334-3a90-42b7-82fc-b110cd8afe12]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:10 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932.1e9f2e3a-adcb-4839-94cf-11f87c7a6824" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=132,cinder:SELECT=119,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-1e9f2e3a-adcb-4839-94cf-11f87c7a6824" released by "_delete_snapshot" :: held 2.835s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" released by "delete_snapshot" :: held 2.894s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:10 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:10 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Created reservations ['fbbdefd2-49db-415a-b5a2-6fc25d7516fb', 'fb22cf94-1a4f-46af-b467-6ca21cae85e7', 'da87c68f-e57b-466b-a853-eb3097360b9a', '2a5b0d28-1d64-4c37-bd97-37725794abe8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Delete snapshot completed successfully. Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54c9214c-6b55-469f-b48f-a486a73c6f99 tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-1e9f2e3a-adcb-4839-94cf-11f87c7a6824-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-7c57f7c3-d80e-4417-9087-0ec2aafec932-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:10 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.4ce01c7b-49bc-40ad-9f6f-9e2390ea3ccazm9tf4p4.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:10 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Converted 1024.00 MB image at 232.05 MB/s Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-7c57f7c3-d80e-4417-9087-0ec2aafec932-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] 4ce01c7b-49bc-40ad-9f6f-9e2390ea3cca was raw, no need to convert to raw {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 19:17:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d314d8bd-dc10-43c8-845d-2efecdc3f384]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:11 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 Jul 21 19:17:11 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:11 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:11 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932 Jul 21 19:17:11 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:11 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7c57f7c3-d80e-4417-9087-0ec2aafec932" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-quobyte-7c57f7c3-d80e-4417-9087-0ec2aafec932" released by "delete_volume" :: held 0.715s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Created reservations ['93527004-b346-4de2-b20c-6fb7066f84b2', 'dd127bc0-7b4a-469f-9f66-141060915ac2', 'be52fb54-d376-4764-a957-49262c8a5e49', '089c6d88-1ee0-4745-9793-afca7d876f25'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:11 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:11 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:12 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Deleted volume successfully. Jul 21 19:17:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e4ce580-21bc-4de4-9044-e811e00c594f tempest-VolumesSnapshotListTestJSON-1792793757 None] Lock "cinder-7c57f7c3-d80e-4417-9087-0ec2aafec932-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Flow 'volume_create_manager' (8257c739-5a54-4bbc-927f-8a7c3ca16d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dcb39e-d816-43fb-80b7-49f589d91a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dcb39e-d816-43fb-80b7-49f589d91a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-364940548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0b8a1c-026b-47e6-b6ec-ac3e909ea212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0289133e4e4072952c7d1b2c85672f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:16Z,use_quota=True,user_id='12925ba0671c4343abf305a592f84ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1b25f1-0c8e-4f83-ac9d-96899ffa0a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1b25f1-0c8e-4f83-ac9d-96899ffa0a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48297335-dda8-4117-8657-9095d4581fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48297335-dda8-4117-8657-9095d4581fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0b8a1c-026b-47e6-b6ec-ac3e909ea212', 'volume_name': 'volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f88ccc-bbb9-46c8-9459-7c2fe488bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f88ccc-bbb9-46c8-9459-7c2fe488bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257c5ce-89d3-44ae-bc0e-abdc290c4be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Volume 2a0b8a1c-026b-47e6-b6ec-ac3e909ea212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212', 'volume_size': 2} Jul 21 19:17:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=41,cinder:DELETE=3,cinder:SELECT=47,cinder:INSERT=12 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:25 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:25 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:25 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:17:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.846s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Uploaded volume to glance image-id: 4ce01c7b-49bc-40ad-9f6f-9e2390ea3cca. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a45ed819-7168-4b4a-ad5c-885081db38e4 req-17079d40-0f58-4585-ab35-0b2a9ae7ab05 tempest-TestStampPattern-2099318761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.932s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a45ed819-7168-4b4a-ad5c-885081db38e4 req-17079d40-0f58-4585-ab35-0b2a9ae7ab05 tempest-TestStampPattern-2099318761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.233s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-155034375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfb86dc-10ec-4879-9a9a-69b1eef02f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887134ed70ad438ab7d0abbf2b40fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:06Z,use_quota=True,user_id='67f8e13b8f0740aeba093f50e0a789ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Creating volume 6bfb86dc-10ec-4879-9a9a-69b1eef02f25 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:30 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6305afce-e207-4d18-bb6f-7d52800576b8 tempest-VolumesActionsTest-826648911 None] Copy volume to image completed successfully. Jul 21 19:17:30 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 1073741824 Jul 21 19:17:30 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-a45ed819-7168-4b4a-ad5c-885081db38e4 req-17079d40-0f58-4585-ab35-0b2a9ae7ab05 tempest-TestStampPattern-2099318761 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-fd3fde60-572a-4e1e-9f11-12d797fac88c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe66c888-08c4-4d73-b1fe-6a6011988d7b', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:17:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a45ed819-7168-4b4a-ad5c-885081db38e4 req-17079d40-0f58-4585-ab35-0b2a9ae7ab05 tempest-TestStampPattern-2099318761 None] attachment_update completed successfully. Jul 21 19:17:31 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 1073741824" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:31 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 Jul 21 19:17:31 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:31 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.907s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-364940548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0b8a1c-026b-47e6-b6ec-ac3e909ea212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0289133e4e4072952c7d1b2c85672f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:16Z,use_quota=True,user_id='12925ba0671c4343abf305a592f84ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Creating volume 2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:31 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 2147483648 Jul 21 19:17:31 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be042145-9653-48c5-9222-d4c2d0411f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6bb68b-6645-4f2a-9a67-87d110a443ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Volume volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 (6bfb86dc-10ec-4879-9a9a-69b1eef02f25): created successfully Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6bb68b-6645-4f2a-9a67-87d110a443ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Flow 'volume_create_manager' (39ddef7d-7cc1-4904-9347-93ca4ecbafaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-349eca24-01eb-49ad-8a05-354d4f8fe31c tempest-VolumesTransfersTest-1224655999 None] Created volume successfully. Jul 21 19:17:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:32 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 2147483648" returned: 0 in 0.585s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:32 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 Jul 21 19:17:32 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "cinder-6bfb86dc-10ec-4879-9a9a-69b1eef02f25-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-6bfb86dc-10ec-4879-9a9a-69b1eef02f25-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "cinder-quobyte-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-quobyte-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eda282-5549-4e2d-9ca5-6d5422b57bc6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:32 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.627s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257c5ce-89d3-44ae-bc0e-abdc290c4be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e253c10b-db88-4c10-8979-9ed65632912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46df4ba-5965-406e-8455-1364b5b1eb12]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:32 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 Jul 21 19:17:32 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Volume volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 (2a0b8a1c-026b-47e6-b6ec-ac3e909ea212): created successfully Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e253c10b-db88-4c10-8979-9ed65632912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Flow 'volume_create_manager' (8257c739-5a54-4bbc-927f-8a7c3ca16d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-caa0423f-9f06-42aa-8fa6-af9b131845b2 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Created volume successfully. Jul 21 19:17:32 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:32 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:33 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:33 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25 Jul 21 19:17:33 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:33 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1915da-9673-4bb1-8552-0f9c37c1cfb3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:33 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:33 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:33 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-quobyte-6bfb86dc-10ec-4879-9a9a-69b1eef02f25" released by "delete_volume" :: held 0.902s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Created reservations ['ae945f24-4e61-4d45-aa77-56262ed43474', 'ff048e40-930e-425a-bc56-8ce03650cbb5', '8ea09a55-35d3-4b9c-a0aa-e897ba93b610', '820baf65-9e05-4c34-8a8f-274de91d8307'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:33 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:33 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:33 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:33 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img Jul 21 19:17:33 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:33 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Deleted volume successfully. Jul 21 19:17:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-024bae8a-fa98-4432-858c-095e5af02e6e tempest-VolumesTransfersTest-1978789113 None] Lock "cinder-6bfb86dc-10ec-4879-9a9a-69b1eef02f25-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-441a1be1-41c7-440e-a506-885a2623bffa req-0199c08f-b543-4dd1-a2f2-3100bffd5e71 tempest-TestStampPattern-2099318761 None] Terminate volume connection completed successfully. Jul 21 19:17:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-441a1be1-41c7-440e-a506-885a2623bffa req-0199c08f-b543-4dd1-a2f2-3100bffd5e71 tempest-TestStampPattern-2099318761 None] Deleting attachment fe66c888-08c4-4d73-b1fe-6a6011988d7b. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:17:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img" returned: 0 in 5.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9308f3c-acf2-4d7c-9f72-b0230cf0f431]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:39 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:39 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:40 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.688s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:40 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Converted 1024.00 MB image at 179.10 MB/s Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] 7a6957f2-77e1-40c3-977f-ce03653ac76f was raw, converting to qcow2 {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0552375-9bf0-4fbd-b375-b2616bc06d2c]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img Jul 21 19:17:40 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:40 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img Jul 21 19:17:40 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:40 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img" returned: 1 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:17:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img /opt/stack/data/cinder/conversion/vol_upload_66bldprd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img /opt/stack/data/cinder/conversion/vol_upload_66bldprd Jul 21 19:17:41 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img /opt/stack/data/cinder/conversion/vol_upload_66bldprd" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:41 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Image conversion details: src /opt/stack/data/cinder/conversion/5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6.temp_image.7a6957f2-77e1-40c3-977f-ce03653ac76f46c3pm8s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_66bldprd {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:17:41 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 19:17:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9acdf-c355-4d21-a6e5-2f60d7389544]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_66bldprd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:41 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_66bldprd Jul 21 19:17:41 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:41 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_66bldprd" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.566s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Uploaded volume to glance image-id: 7a6957f2-77e1-40c3-977f-ce03653ac76f. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.862s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Creating offline snapshot ca211707-2452-40b2-9d89-9611ac3a9250 of volume 2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:17:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b103d79-fc1c-4add-acda-eed39f3f7db0 tempest-VolumesActionsTest-826648911 None] Copy volume to image completed successfully. Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f5956-1c7d-4093-9de9-77180bbf3499]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Flow 'volume_create_manager' (5cf2abdc-6688-4754-83db-a7352156330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd730de-d8a3-4efa-8398-828e5eb230ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd730de-d8a3-4efa-8398-828e5eb230ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535383088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9321a-120b-423e-9e05-b3e1b2e9b5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f8d99f4f744c8abdf6e4b28927c73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:43Z,use_quota=True,user_id='a532d86edcdc400d81929fc420337ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df37a28d-0d12-4d8b-b3a9-fe336ec1f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df37a28d-0d12-4d8b-b3a9-fe336ec1f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05a03a-a531-4bf2-8504-e1f20b814f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b05a03a-a531-4bf2-8504-e1f20b814f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd9321a-120b-423e-9e05-b3e1b2e9b5e3', 'volume_name': 'volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3595015-c6e1-46e7-9490-af54ec732110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:43 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 Jul 21 19:17:43 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3595015-c6e1-46e7-9490-af54ec732110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4da53-b061-4a5d-ac19-95ded2e6f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Volume 9dd9321a-120b-423e-9e05-b3e1b2e9b5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3', 'volume_size': 2} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:43 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:43 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 2G Jul 21 19:17:43 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 2G" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 Jul 21 19:17:44 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 is being set with open permissions: ugo+rw Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 Jul 21 19:17:44 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info Jul 21 19:17:44 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Acquiring lock "cinder-quobyte-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "cinder-quobyte-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7334aa-cb2e-4914-99c2-d1684e6b90df]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info is being set with open permissions: ugo+rw Jul 21 19:17:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:44 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info Jul 21 19:17:44 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:45 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:45 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:45 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.info" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.501s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Creating offline snapshot ff511c41-346c-457a-8eed-7e825e9733c0 of volume fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0d74a0-98e7-4438-aedd-77569ab0d791]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a0592bff-8b36-4be3-9162-8a8c0ecaa272 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Create snapshot completed successfully Jul 21 19:17:45 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:45 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6 Jul 21 19:17:45 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:45 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:17:45 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:45 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:45 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "cinder-quobyte-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6" released by "delete_volume" :: held 0.757s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:45 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 1G Jul 21 19:17:45 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Created reservations ['aa66fb29-66f2-4f3f-a7ae-a326234aef90', 'e6d8b5b9-8ac7-4f90-b82b-f2965a2600b1', '7b07c914-8522-4249-89c3-46754babe78e', '38193d4b-2bd9-464b-a428-b768c3f8361a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:45 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:45 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:46 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Deleted volume successfully. Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5323adad-219a-42d7-b58f-df8e6cff876e tempest-VolumesActionsTest-826648911 None] Lock "cinder-5f98a8be-acf6-4fd1-bb89-2b9e7e8d43c6-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "cinder-ca211707-2452-40b2-9d89-9611ac3a9250-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-ca211707-2452-40b2-9d89-9611ac3a9250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "cinder-quobyte-ca211707-2452-40b2-9d89-9611ac3a9250" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-ca211707-2452-40b2-9d89-9611ac3a9250" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Deleting offline snapshot ca211707-2452-40b2-9d89-9611ac3a9250 of volume 2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:17:46 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] snapshot_file for this snap is: volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 1G" returned: 0 in 0.606s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3fde60-572a-4e1e-9f11-12d797fac88c -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d82c6d-b743-44ed-8c36-55f45e1ae197]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:46 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3fde60-572a-4e1e-9f11-12d797fac88c -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:17:46 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:46 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 Jul 21 19:17:46 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:46 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd3fde60-572a-4e1e-9f11-12d797fac88c -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 is being set with open permissions: ugo+rw Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:46 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:17:46 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:46 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[184d3ae4-efa9-4a9f-bc03-fb4f12d8669b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:46 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:46 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 Jul 21 19:17:46 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:46 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info Jul 21 19:17:46 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:47 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:47 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:47 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info is being set with open permissions: ugo+rw Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:47 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 Jul 21 19:17:47 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:47 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info Jul 21 19:17:47 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:47 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.info" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.285s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535383088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd9321a-120b-423e-9e05-b3e1b2e9b5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f8d99f4f744c8abdf6e4b28927c73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:43Z,use_quota=True,user_id='a532d86edcdc400d81929fc420337ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Creating volume 9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:47 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:47 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 2147483648 Jul 21 19:17:47 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:47 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250 Jul 21 19:17:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b67fd725-d9b1-4699-8767-497bf51e6271 tempest-TestStampPattern-2099318761 None] Create snapshot completed successfully Jul 21 19:17:47 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:47 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212.ca211707-2452-40b2-9d89-9611ac3a9250" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-ca211707-2452-40b2-9d89-9611ac3a9250" released by "_delete_snapshot" :: held 1.752s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" released by "delete_snapshot" :: held 1.786s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Created reservations ['c9fb82bc-0ab6-439c-af24-fdc8e8ff4f3a', '4075a72e-7bcc-4596-aeb1-8efa44d250e6', '7f9e7127-f857-4d06-bd24-fd9946054c1c', 'b1b53d66-7945-4c4a-9fb3-4696eace567a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Delete snapshot completed successfully. Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f060cd4a-39ad-4c53-a798-8afb3b4bc683 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-ca211707-2452-40b2-9d89-9611ac3a9250-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:48 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 2147483648" returned: 0 in 0.635s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:48 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 Jul 21 19:17:48 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "cinder-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:48 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e147c9c-8464-4cfb-9039-e1bb7d1ed116]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4da53-b061-4a5d-ac19-95ded2e6f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06f659-2f91-4845-92e9-924447fd633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Volume volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 (9dd9321a-120b-423e-9e05-b3e1b2e9b5e3): created successfully Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06f659-2f91-4845-92e9-924447fd633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Flow 'volume_create_manager' (5cf2abdc-6688-4754-83db-a7352156330d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d65ace4-02b2-4bd6-ab4e-7da0620c402b tempest-VolumesCloneNegativeTest-1197453773 None] Created volume successfully. Jul 21 19:17:48 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 Jul 21 19:17:48 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:49 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:49 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212 Jul 21 19:17:49 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:49 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-quobyte-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212" released by "delete_volume" :: held 0.936s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Created reservations ['474e3df5-1656-4ef4-87b6-ddeb43f8c624', '40b27bd1-4492-4218-b7d6-05e4e6110cd5', '76c785a6-b87b-4ab3-a351-da4b8e55bfa4', '85dd554b-5b3c-4d6c-b4c3-966873fecd6f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:49 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:49 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Acquiring lock "cinder-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "cinder-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Acquiring lock "cinder-quobyte-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "cinder-quobyte-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6b208-216e-4271-9966-18b7b818de5f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:50 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Deleted volume successfully. Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bad80f6b-0a93-47a5-a28a-cffc4ea3b644 tempest-VolumesSnapshotNegativeTestJSON-703579781 None] Lock "cinder-2a0b8a1c-026b-47e6-b6ec-ac3e909ea212-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:50 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 Jul 21 19:17:50 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:50 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:50 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3 Jul 21 19:17:50 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:50 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "cinder-quobyte-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3" released by "delete_volume" :: held 0.822s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Created reservations ['d237435f-87d5-4172-88e6-1aea488f1deb', 'd1947c51-b785-463e-b728-92f58492eebd', '99a61819-cbb1-405d-980b-cc4b684bc96d', '3dffbd03-c033-4971-81aa-e01cb3988c00'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:51 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:17:51 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:51 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:17:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Deleted volume successfully. Jul 21 19:17:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb29cbf7-6ebf-4d26-903c-f6f98c786b93 tempest-VolumesCloneNegativeTest-1197453773 None] Lock "cinder-9dd9321a-120b-423e-9e05-b3e1b2e9b5e3-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (9f487ab0-9f10-448b-97f6-0ffee938e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10960c5-49e6-4778-b94c-5a079bf1c2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10960c5-49e6-4778-b94c-5a079bf1c2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1658131024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ef6867-0e3a-4c4a-aff3-85761e6a1e00,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cc215-6cdf-4b9d-ae1f-67b64ef37911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cc215-6cdf-4b9d-ae1f-67b64ef37911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73445ea-19d8-4c8c-b837-efd5d0e72660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73445ea-19d8-4c8c-b837-efd5d0e72660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ef6867-0e3a-4c4a-aff3-85761e6a1e00', 'volume_name': 'volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf89c7a-cb34-49d2-876a-05de83d32c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf89c7a-cb34-49d2-876a-05de83d32c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f7d5f3-6303-4724-a3d7-8653b5a6ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Volume 60ef6867-0e3a-4c4a-aff3-85761e6a1e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00', 'volume_size': 1} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1658131024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ef6867-0e3a-4c4a-aff3-85761e6a1e00,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:54Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Creating volume 60ef6867-0e3a-4c4a-aff3-85761e6a1e00 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:53 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 1073741824 Jul 21 19:17:53 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:54 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 1073741824" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:54 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 Jul 21 19:17:54 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:54 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f7d5f3-6303-4724-a3d7-8653b5a6ada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b212541d-5584-45db-9c5f-ea2504534ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Volume volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 (60ef6867-0e3a-4c4a-aff3-85761e6a1e00): created successfully Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b212541d-5584-45db-9c5f-ea2504534ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (9f487ab0-9f10-448b-97f6-0ffee938e706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6552819c-4a82-4e3c-a63c-cb54ade351c4 tempest-VolumesListTestJSON-977713224 None] Created volume successfully. Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (5c741d9b-0e48-41f9-9920-0d2b2e61819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da926d04-0f06-4efc-8191-732d78e56871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da926d04-0f06-4efc-8191-732d78e56871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-189160872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b94e83-2578-44ab-b8e3-a136920f7e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b94e83-2578-44ab-b8e3-a136920f7e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4229b0-c22a-4899-b5ef-03329fdc92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4229b0-c22a-4899-b5ef-03329fdc92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c', 'volume_name': 'volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995bb4b3-5180-42c1-ae39-9d9c8156547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995bb4b3-5180-42c1-ae39-9d9c8156547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be9f54-3ff9-45c0-b76f-dd48f9c31911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Volume 6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c', 'volume_size': 1} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-189160872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Creating volume 6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:17:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:55 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c 1073741824 Jul 21 19:17:55 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Flow 'volume_create_manager' (8e66e252-9487-4f30-a496-c96792c69e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d396d1cd-4417-48ac-8830-fa918699ab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d396d1cd-4417-48ac-8830-fa918699ab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-844252187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2224f342-ada0-4fbc-82cf-285241b641df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961f038ee77f4926afe4fd4729c3416a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff511c41-346c-457a-8eed-7e825e9733c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:56Z,use_quota=True,user_id='6172e8b92079412b9b1ecffd4192d398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f8bfa7-ff7d-4281-bdb6-99f96979dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f8bfa7-ff7d-4281-bdb6-99f96979dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a670e7-ac5a-49d7-a418-f8f70f864b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a670e7-ac5a-49d7-a418-f8f70f864b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2224f342-ada0-4fbc-82cf-285241b641df', 'volume_name': 'volume-2224f342-ada0-4fbc-82cf-285241b641df', 'volume_size': 1, 'snapshot_id': 'ff511c41-346c-457a-8eed-7e825e9733c0'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676342c3-2f64-4bed-afb4-5eb68eb033d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (676342c3-2f64-4bed-afb4-5eb68eb033d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bdd276-6b3c-4b62-b420-f1d14267f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Volume 2224f342-ada0-4fbc-82cf-285241b641df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2224f342-ada0-4fbc-82cf-285241b641df', 'volume_size': 1, 'snapshot_id': 'ff511c41-346c-457a-8eed-7e825e9733c0'} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:56 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c 1073741824" returned: 0 in 0.713s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:56 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c Jul 21 19:17:56 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (f44dfdf1-7903-4e2a-9365-f2fa11d44767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cfe84-06e9-4a34-a35b-ceca1e33d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77cfe84-06e9-4a34-a35b-ceca1e33d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537324256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343646dc-bb78-4995-b766-5f3a59ca5ae8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393a28b5-86a7-404e-928f-5fe0184a295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393a28b5-86a7-404e-928f-5fe0184a295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851a9ac1-155c-4005-a329-720a9855f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851a9ac1-155c-4005-a329-720a9855f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343646dc-bb78-4995-b766-5f3a59ca5ae8', 'volume_name': 'volume-343646dc-bb78-4995-b766-5f3a59ca5ae8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6126cbd6-2814-480b-8d1f-3dcce1a67db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6126cbd6-2814-480b-8d1f-3dcce1a67db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eec469-5c61-464b-b6e4-161b707ee3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Volume 343646dc-bb78-4995-b766-5f3a59ca5ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343646dc-bb78-4995-b766-5f3a59ca5ae8', 'volume_size': 1} Jul 21 19:17:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:57 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.470s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0-2224f342-ada0-4fbc-82cf-285241b641df" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be9f54-3ff9-45c0-b76f-dd48f9c31911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9330d5cb-f834-4a0c-9512-199ef9695068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0-2224f342-ada0-4fbc-82cf-285241b641df" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Creating volume 2224f342-ada0-4fbc-82cf-285241b641df from snapshot ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:17:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Volume volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c (6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c): created successfully Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9330d5cb-f834-4a0c-9512-199ef9695068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (5c741d9b-0e48-41f9-9920-0d2b2e61819e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] snapshot: ff511c41-346c-457a-8eed-7e825e9733c0, volume: 2224f342-ada0-4fbc-82cf-285241b641df, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:17:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d243e2e-a2f6-4da1-8d59-7c1d6982c7d2 tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[251c6330-aa26-4059-b697-01913cd3f718]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:17:57 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:57 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3fde60-572a-4e1e-9f11-12d797fac88c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f2abec-52e5-422c-a363-2d07e03d0c23]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:17:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:57 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:17:57 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:58 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 21 19:17:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:17:58 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:17:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:17:58 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df Jul 21 19:17:58 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (256b7bfa-5f64-47ae-ac20-b56550002e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057c7f87-fa7b-4ebd-b3be-fb65038d2ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057c7f87-fa7b-4ebd-b3be-fb65038d2ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-793606103',display_name='tempest-VolumesGetTest-Volume-1246511773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e62d8c-1f87-44c7-b9b0-e52b684f3e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:59Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f1b885-ada5-43b1-b3ee-6b0730435bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f1b885-ada5-43b1-b3ee-6b0730435bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d15ac71-6057-4b21-95ad-1b5b57528f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d15ac71-6057-4b21-95ad-1b5b57528f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e62d8c-1f87-44c7-b9b0-e52b684f3e2e', 'volume_name': 'volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0373ee-fa00-4434-abeb-21d2726662a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0373ee-fa00-4434-abeb-21d2726662a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deb8148-2a5c-4d8e-aec7-88eb113fe868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:17:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Volume 96e62d8c-1f87-44c7-b9b0-e52b684f3e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e', 'volume_size': 1} Jul 21 19:17:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:04 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df" returned: 0 in 6.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc5fef-47c1-4531-8d3e-1a991abdad0a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:04 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:18:04 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.835s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:05 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Converted 1024.00 MB image at 158.83 MB/s Jul 21 19:18:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df is being set with open permissions: ugo+rw Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df Jul 21 19:18:05 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" released by "_copy_volume_from_snapshot" :: held 8.637s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0-2224f342-ada0-4fbc-82cf-285241b641df" released by "_create_volume_from_snapshot" :: held 8.689s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.724s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.900s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537324256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343646dc-bb78-4995-b766-5f3a59ca5ae8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:57Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Creating volume 343646dc-bb78-4995-b766-5f3a59ca5ae8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:05 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 1073741824 Jul 21 19:18:05 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bdd276-6b3c-4b62-b420-f1d14267f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2224f342-ada0-4fbc-82cf-285241b641df', 'volume_size': 1, 'snapshot_id': 'ff511c41-346c-457a-8eed-7e825e9733c0'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3df51a-d508-4c7a-b6b4-e62985fa8722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Volume volume-2224f342-ada0-4fbc-82cf-285241b641df (2224f342-ada0-4fbc-82cf-285241b641df): created successfully Jul 21 19:18:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3df51a-d508-4c7a-b6b4-e62985fa8722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Flow 'volume_create_manager' (8e66e252-9487-4f30-a496-c96792c69e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-871feb1c-214f-4393-9cae-194d561679a7 tempest-TestStampPattern-2099318761 None] Created volume successfully. Jul 21 19:18:06 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 1073741824" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 Jul 21 19:18:06 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.359s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:17:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-793606103',display_name='tempest-VolumesGetTest-Volume-1246511773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e62d8c-1f87-44c7-b9b0-e52b684f3e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:17:59Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Creating volume 96e62d8c-1f87-44c7-b9b0-e52b684f3e2e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eec469-5c61-464b-b6e4-161b707ee3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343646dc-bb78-4995-b766-5f3a59ca5ae8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d843b8e1-572d-4c3e-8de3-02c28ca4ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:06 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e 1073741824 Jul 21 19:18:06 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Volume volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 (343646dc-bb78-4995-b766-5f3a59ca5ae8): created successfully Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d843b8e1-572d-4c3e-8de3-02c28ca4ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (f44dfdf1-7903-4e2a-9365-f2fa11d44767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5d1592c-fbc1-4d45-b746-0482321d8eff tempest-VolumesListTestJSON-977713224 None] Created volume successfully. Jul 21 19:18:07 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e 1073741824" returned: 0 in 0.677s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:07 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e Jul 21 19:18:07 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:07 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deb8148-2a5c-4d8e-aec7-88eb113fe868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e8c62d-975e-43b7-8a37-25df81accf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Volume volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e (96e62d8c-1f87-44c7-b9b0-e52b684f3e2e): created successfully Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e8c62d-975e-43b7-8a37-25df81accf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (256b7bfa-5f64-47ae-ac20-b56550002e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90f220b3-acf4-4be2-8658-2a54545e256e tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (30f6f4ae-d918-4f44-8ed3-3089e8c2ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2eb035-b125-451c-b685-151b999fd63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2eb035-b125-451c-b685-151b999fd63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1390760219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf07dfc-9620-44a3-9453-f5f50f6c5bbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:08Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db8ae55-216f-4f05-ac8e-f4f64da55db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db8ae55-216f-4f05-ac8e-f4f64da55db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd46f84d-164b-4442-ad85-f3d7cdee89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd46f84d-164b-4442-ad85-f3d7cdee89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf07dfc-9620-44a3-9453-f5f50f6c5bbc', 'volume_name': 'volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8077eced-8ff6-448f-afba-e51bea9b8857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8077eced-8ff6-448f-afba-e51bea9b8857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1920e424-7d74-4654-8b2a-c719db929865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Volume eaf07dfc-9620-44a3-9453-f5f50f6c5bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc', 'volume_size': 1} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1390760219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf07dfc-9620-44a3-9453-f5f50f6c5bbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90bdfb1b7894b8ab8be517e16bf4558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:08Z,use_quota=True,user_id='e59a5004b5614fa197d747a06b3e63e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Creating volume eaf07dfc-9620-44a3-9453-f5f50f6c5bbc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc 1073741824 Jul 21 19:18:08 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "cinder-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc 1073741824" returned: 0 in 0.611s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f5fdd-d25c-474b-82e8-8d4be088ee49]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:08 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc Jul 21 19:18:08 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:08 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e Jul 21 19:18:08 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" returned: 0 in 0.611s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:09 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" returned: 0 in 0.607s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1920e424-7d74-4654-8b2a-c719db929865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192c00eb-b3d7-4e86-a4b9-47bc49c7411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:09 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e Jul 21 19:18:09 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Volume volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc (eaf07dfc-9620-44a3-9453-f5f50f6c5bbc): created successfully Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192c00eb-b3d7-4e86-a4b9-47bc49c7411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Flow 'volume_create_manager' (30f6f4ae-d918-4f44-8ed3-3089e8c2ea23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ecd47af8-4e94-493c-b8ae-6d13c4cb508e tempest-VolumesListTestJSON-977713224 None] Created volume successfully. Jul 21 19:18:10 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" returned: 0 in 0.617s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e" released by "delete_volume" :: held 1.335s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Created reservations ['c548bd09-98df-4439-844a-eb9888a55199', 'dd1d67b6-4d57-421a-bc5a-3dc4a76bcb0a', 'c895b4f1-f66f-4083-bdd9-28ee50f71a35', '0c732d5f-eb95-4d7b-ae03-47142f8b95a7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:10 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:10 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:11 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.819s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb3793da-af9d-48c7-aaf3-88a56c0da421 tempest-VolumesGetTest-58993452 None] Lock "cinder-96e62d8c-1f87-44c7-b9b0-e52b684f3e2e-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "cinder-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ba0f4-440d-4ba6-86cd-1389146c6d3c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:11 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c Jul 21 19:18:11 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:12 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" returned: 0 in 0.801s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:12 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c Jul 21 19:18:12 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:12 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" returned: 0 in 0.517s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c" released by "delete_volume" :: held 1.422s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Created reservations ['461735e6-b9b7-44f7-85ba-64fdcd36714f', 'ad267d1b-f1cf-48e5-b928-542f4b5e43ba', '1d1b8fc0-a8d1-4f88-b9f9-11ec9038e6dc', '7db55432-0738-4abf-ad24-ebb6cb63a06c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:13 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:13 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:13 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:18:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e2a74aea-840e-4b7d-9375-fa46e4457067 tempest-VolumesGetTest-58993452 None] Lock "cinder-6a12dd48-4d3b-48b6-a28c-e6a1b4baf15c-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-quobyte-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122c731-be0f-4733-a898-a9f22884f601]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (6ba15185-3732-4f10-ab76-0b1a98c87420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b9dcb1-54ca-4b49-a8de-329d5fa52d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:14 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc Jul 21 19:18:14 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b9dcb1-54ca-4b49-a8de-329d5fa52d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822771566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ef34ae-f089-4b2c-973d-191d85365270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:15Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5994a32-d479-4229-932d-97baaf9b8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5994a32-d479-4229-932d-97baaf9b8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d53bf4-cae2-48b3-b4eb-e7500bd7d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d53bf4-cae2-48b3-b4eb-e7500bd7d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ef34ae-f089-4b2c-973d-191d85365270', 'volume_name': 'volume-c4ef34ae-f089-4b2c-973d-191d85365270', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8dd8da-5653-4fa5-83c7-2bb9f53e5c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8dd8da-5653-4fa5-83c7-2bb9f53e5c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327be5c4-d79c-4a31-9a34-f02f01efa9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Volume c4ef34ae-f089-4b2c-973d-191d85365270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ef34ae-f089-4b2c-973d-191d85365270', 'volume_size': 1} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822771566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ef34ae-f089-4b2c-973d-191d85365270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:15Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Creating volume c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:15 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 1073741824 Jul 21 19:18:15 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:15 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" returned: 0 in 0.574s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:15 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc Jul 21 19:18:15 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:15 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc" released by "delete_volume" :: held 1.197s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:15 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 1073741824" returned: 0 in 0.878s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Created reservations ['45f0e05a-289a-420d-9a14-fe8545af39cf', '32e5e34b-a43f-49a5-bb18-171a6b8c7070', '10a404ed-5fbd-4af3-9025-76ee84f9caf3', 'a498d8e6-73a9-4932-8eac-4bad91e89022'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:16 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:16 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:16 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:16 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:16 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327be5c4-d79c-4a31-9a34-f02f01efa9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ef34ae-f089-4b2c-973d-191d85365270', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a9645b-dcc5-4d85-a85d-210abea4dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Volume volume-c4ef34ae-f089-4b2c-973d-191d85365270 (c4ef34ae-f089-4b2c-973d-191d85365270): created successfully Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a9645b-dcc5-4d85-a85d-210abea4dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (6ba15185-3732-4f10-ab76-0b1a98c87420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-343e8381-acc5-47ea-81c4-d3651509d01c tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:16 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Deleted volume successfully. Jul 21 19:18:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6800ae73-b8db-442b-a8eb-7d3f27149a18 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-eaf07dfc-9620-44a3-9453-f5f50f6c5bbc-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-343646dc-bb78-4995-b766-5f3a59ca5ae8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-343646dc-bb78-4995-b766-5f3a59ca5ae8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-quobyte-343646dc-bb78-4995-b766-5f3a59ca5ae8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-343646dc-bb78-4995-b766-5f3a59ca5ae8" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c4a13-bc09-4e72-8161-bf540552cc1e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:17 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 Jul 21 19:18:17 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (03b02cd0-b46a-41cb-8713-19d5aee29e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b55cc8-643c-4a61-b669-8668abfa4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b55cc8-643c-4a61-b669-8668abfa4843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-491640018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6541a3-346d-4491-9623-83c41dd51c50,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c4ef34ae-f089-4b2c-973d-191d85365270,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:18Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8291de38-8105-4390-bb6c-eb57cf8b6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8291de38-8105-4390-bb6c-eb57cf8b6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcdef1f-e75c-4893-aa91-621bf413505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcdef1f-e75c-4893-aa91-621bf413505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4b6541a3-346d-4491-9623-83c41dd51c50', 'volume_name': 'volume-4b6541a3-346d-4491-9623-83c41dd51c50', 'volume_size': 1, 'source_volid': 'c4ef34ae-f089-4b2c-973d-191d85365270', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011c2bc6-4283-4f07-b7c6-c476ab5e7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011c2bc6-4283-4f07-b7c6-c476ab5e7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:18 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6f4293-9a64-4abb-97bb-bdbf4b1251ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Volume 4b6541a3-346d-4491-9623-83c41dd51c50: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4b6541a3-346d-4491-9623-83c41dd51c50', 'volume_size': 1, 'source_volid': 'c4ef34ae-f089-4b2c-973d-191d85365270', 'source_volstatus': 'available'} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8" returned: 0 in 0.680s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Cloning volume c4ef34ae-f089-4b2c-973d-191d85365270 to volume 4b6541a3-346d-4491-9623-83c41dd51c50 Jul 21 19:18:18 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8 Jul 21 19:18:18 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Creating offline snapshot 58a1c52d-1aae-454d-ad03-797b4d40121f of volume c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f074fc3-7263-4f32-9fa4-2975d35e1a5a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:18 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:18 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:18 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-343646dc-bb78-4995-b766-5f3a59ca5ae8" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-343646dc-bb78-4995-b766-5f3a59ca5ae8" released by "delete_volume" :: held 1.143s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Created reservations ['3c459c17-cbe8-4930-b241-d803081aacbf', 'bf2378ec-f327-4cd7-9419-4e1f53de6123', 'aa0c0278-eb92-44aa-ba8e-29fd7b5cfb3d', '8a74b0c4-44f4-48a6-96dd-ec50b489cb34'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:19 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:19 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.752s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f 1G Jul 21 19:18:19 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:19 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Deleted volume successfully. Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1c1d9dd3-cd25-49cb-a793-dac51fc98013 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-343646dc-bb78-4995-b766-5f3a59ca5ae8-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:19 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f 1G" returned: 0 in 0.641s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef34ae-f089-4b2c-973d-191d85365270 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:19 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef34ae-f089-4b2c-973d-191d85365270 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:19 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-60ef6867-0e3a-4c4a-aff3-85761e6a1e00-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-60ef6867-0e3a-4c4a-aff3-85761e6a1e00-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "cinder-quobyte-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c96c5ef-6c96-42af-a0ad-93eed3a71313]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 Jul 21 19:18:20 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef34ae-f089-4b2c-973d-191d85365270 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.818s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f is being set with open permissions: ugo+rw Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:20 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:20 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:20 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00 Jul 21 19:18:20 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.538s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info Jul 21 19:18:21 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-quobyte-60ef6867-0e3a-4c4a-aff3-85761e6a1e00" released by "delete_volume" :: held 0.971s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Created reservations ['4ef32397-5df1-4cc3-bcb7-aad00ec170bc', '5eb1ce8e-12af-41ad-8fb6-619c4dc34270', 'b6d80166-fc6d-46ce-ab0b-41228c47ff6a', '34305ac3-0f58-450b-9118-2ff2a9c7473c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:21 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info is being set with open permissions: ugo+rw Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:21 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info Jul 21 19:18:21 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:21 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Deleted volume successfully. Jul 21 19:18:21 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.info" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3085c81c-902a-4461-a0dd-b99ef49a5533 tempest-VolumesListTestJSON-977713224 None] Lock "cinder-60ef6867-0e3a-4c4a-aff3-85761e6a1e00-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] snapshot: 58a1c52d-1aae-454d-ad03-797b4d40121f, volume: 4b6541a3-346d-4491-9623-83c41dd51c50, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b509ee89-ce53-499a-b150-0a8192278971]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:22 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:22 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.613s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ef34ae-f089-4b2c-973d-191d85365270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80211e44-5107-468f-8a94-36e8f407c39e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:22 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:22 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:23 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.728s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:23 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:18:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:23 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 Jul 21 19:18:23 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:25 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:25 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:26 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:18:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:18:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:18:29 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50" returned: 0 in 5.678s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e872394-1300-4fb4-87e6-81aee06ca29d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:29 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:29 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:29 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Converted 1024.00 MB image at 180.32 MB/s Jul 21 19:18:29 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 is being set with open permissions: ugo+rw Jul 21 19:18:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:29 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 Jul 21 19:18:29 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" released by "_copy_volume_from_snapshot" :: held 8.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=95,cinder:UPDATE=100,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-58a1c52d-1aae-454d-ad03-797b4d40121f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-58a1c52d-1aae-454d-ad03-797b4d40121f" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Deleting offline snapshot 58a1c52d-1aae-454d-ad03-797b4d40121f of volume c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] snapshot_file for this snap is: volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e305c53e-0624-4af4-9f0e-75d2971d1d07]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:30 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:30 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.438s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ef34ae-f089-4b2c-973d-191d85365270(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188279f-453f-46f0-940d-2904104f6af7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:30 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:30 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:31 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=84,cinder:UPDATE=126,cinder:INSERT=29,cinder:DELETE=13 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:18:31 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:31 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f Jul 21 19:18:31 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:31 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270.58a1c52d-1aae-454d-ad03-797b4d40121f" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-58a1c52d-1aae-454d-ad03-797b4d40121f" released by "_delete_snapshot" :: held 1.763s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.796s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6f4293-9a64-4abb-97bb-bdbf4b1251ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6541a3-346d-4491-9623-83c41dd51c50', 'volume_size': 1, 'source_volid': 'c4ef34ae-f089-4b2c-973d-191d85365270', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fafa0e-7d48-4ef0-bb6d-f830ae4bf307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Volume volume-4b6541a3-346d-4491-9623-83c41dd51c50 (4b6541a3-346d-4491-9623-83c41dd51c50): created successfully Jul 21 19:18:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fafa0e-7d48-4ef0-bb6d-f830ae4bf307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (03b02cd0-b46a-41cb-8713-19d5aee29e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b4a5766a-f02a-4616-8fd8-ad4d1606cec9 tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (803224b1-8dbd-4573-add3-5fef93b6ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9fdd0c-5060-4705-b069-f4ada1819f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9fdd0c-5060-4705-b069-f4ada1819f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-948241921',display_name='tempest-VolumesGetTest-Volume-1679019181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9614fc-24f1-4e67-9a30-1ff90c6917c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:33Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d755f6-5518-4010-9475-949ae55b9264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d755f6-5518-4010-9475-949ae55b9264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40dd009-7af6-40e1-ad1b-38de2ada96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40dd009-7af6-40e1-ad1b-38de2ada96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9614fc-24f1-4e67-9a30-1ff90c6917c6', 'volume_name': 'volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909846c-5ae2-47bd-885c-7742a27908d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5909846c-5ae2-47bd-885c-7742a27908d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daa8ecc-35b4-4bad-9e05-a1bf9bd8c56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Volume bf9614fc-24f1-4e67-9a30-1ff90c6917c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6', 'volume_size': 1} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-948241921',display_name='tempest-VolumesGetTest-Volume-1679019181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9614fc-24f1-4e67-9a30-1ff90c6917c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:33Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Creating volume bf9614fc-24f1-4e67-9a30-1ff90c6917c6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:33 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 1073741824 Jul 21 19:18:33 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 1073741824" returned: 0 in 0.760s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:34 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 Jul 21 19:18:34 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:34 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daa8ecc-35b4-4bad-9e05-a1bf9bd8c56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c33ce6-b0bc-4129-9f9d-0346a8a2b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Volume volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 (bf9614fc-24f1-4e67-9a30-1ff90c6917c6): created successfully Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c33ce6-b0bc-4129-9f9d-0346a8a2b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (803224b1-8dbd-4573-add3-5fef93b6ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5358e67-2cf2-40fb-8337-c7acbf85627e tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-bf9614fc-24f1-4e67-9a30-1ff90c6917c6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "cinder-bf9614fc-24f1-4e67-9a30-1ff90c6917c6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a622d-ca40-49f3-ae1f-9ec732e2a687]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:36 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 Jul 21 19:18:36 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:36 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:36 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6 Jul 21 19:18:36 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:36 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-bf9614fc-24f1-4e67-9a30-1ff90c6917c6" released by "delete_volume" :: held 0.895s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Created reservations ['dca0b793-01a6-4491-99f5-4db1a4367fda', '682f763f-e54f-4cbe-87a6-9d418e94b671', '03e587d6-248c-48c5-acff-82ac1cfd508b', '408fe776-3ff8-4307-bb67-f650715659f6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:37 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:37 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:37 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:18:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4de7a99-1672-4aa9-bb36-89ee3eb7e2dd tempest-VolumesGetTest-58993452 None] Lock "cinder-bf9614fc-24f1-4e67-9a30-1ff90c6917c6-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-4b6541a3-346d-4491-9623-83c41dd51c50-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "cinder-4b6541a3-346d-4491-9623-83c41dd51c50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[db55c7ea-a2ab-42a7-955d-4ea015c67e47]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:38 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 Jul 21 19:18:38 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50 Jul 21 19:18:39 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:39 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4b6541a3-346d-4491-9623-83c41dd51c50" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-4b6541a3-346d-4491-9623-83c41dd51c50" released by "delete_volume" :: held 0.954s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Created reservations ['b3c1abef-61d3-4ca6-b1ec-9dc92b69aa1e', 'c83c5409-d57b-4aba-825e-98b8e2d97f12', '0364626c-d019-4499-8533-d2104f158c06', '279cdb53-5008-4552-be66-32c0d04454fd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:39 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:39 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c672ab2b-0c1e-4b82-8f4d-eb272915097b tempest-VolumesGetTest-58993452 None] Lock "cinder-4b6541a3-346d-4491-9623-83c41dd51c50-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f4d65b-c0cf-40b6-bd43-9447c28f83f7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:40 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df Jul 21 19:18:40 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-c4ef34ae-f089-4b2c-973d-191d85365270-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "cinder-c4ef34ae-f089-4b2c-973d-191d85365270-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-c4ef34ae-f089-4b2c-973d-191d85365270" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-c4ef34ae-f089-4b2c-973d-191d85365270" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ec43d-1a5f-4374-b5b6-0aad0c6d8f43]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:41 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:41 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.591s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-2224f342-ada0-4fbc-82cf-285241b641df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '337505a5-dc66-40c4-9e5d-d3bd7f359824', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:18:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-597a3bdf-30cc-44e7-9e3e-870a9a6b93fb req-a76466f5-7bfe-4d29-8671-d96b925fa3ac tempest-TestStampPattern-2099318761 None] attachment_update completed successfully. Jul 21 19:18:41 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.631s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:41 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270 Jul 21 19:18:41 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:42 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c4ef34ae-f089-4b2c-973d-191d85365270" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-c4ef34ae-f089-4b2c-973d-191d85365270" released by "delete_volume" :: held 1.255s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Created reservations ['bd4c88d2-4ba9-47bc-b68a-cc0e916f6dfb', 'dbb6db04-9ad4-4fc1-89d5-20d5de92d58a', 'ee846e50-04b8-4cf7-809c-e64a2e3b6b36', '650f6cf7-c1e6-498a-bf27-6a1a0cc12ce2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:42 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:42 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:43 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.748s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:18:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8bb63fc5-3116-48a7-838a-ac58affb34ad tempest-VolumesGetTest-58993452 None] Lock "cinder-c4ef34ae-f089-4b2c-973d-191d85365270-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (ab378625-d120-4da0-9c29-2786c116dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0460914-cf57-4dd5-8a7b-5a20003b593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0460914-cf57-4dd5-8a7b-5a20003b593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271817978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ed9bc9-b395-42f4-9dd7-cc0b6360995f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:45Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3506ca3-bcfe-4150-bb4a-b33aa50bbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3506ca3-bcfe-4150-bb4a-b33aa50bbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9da1ec-fc8a-4fec-beec-f6e31094e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9da1ec-fc8a-4fec-beec-f6e31094e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05ed9bc9-b395-42f4-9dd7-cc0b6360995f', 'volume_name': 'volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a964917e-e0bc-4e6c-9cad-8b79cafd4299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a964917e-e0bc-4e6c-9cad-8b79cafd4299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0533fac3-6e93-401d-b525-40d72e9389fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:18:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Trying to clone 05ed9bc9-b395-42f4-9dd7-cc0b6360995f from image be5d1921-2dfc-4e84-8720-ad78553464c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:18:46 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:18:46 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:18:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc2d70-e934-4ece-ade6-ec05349e7758]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-80d2b5e1-28b9-4446-8555-2a3ae86b3713 req-f0ef3c44-c1e1-4c74-8d40-5a28b150de39 tempest-TestStampPattern-2099318761 None] Terminate volume connection completed successfully. Jul 21 19:18:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-80d2b5e1-28b9-4446-8555-2a3ae86b3713 req-f0ef3c44-c1e1-4c74-8d40-5a28b150de39 tempest-TestStampPattern-2099318761 None] Deleting attachment 337505a5-dc66-40c4-9e5d-d3bd7f359824. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:18:46 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD Jul 21 19:18:46 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 is fetched for user 2f87fd5e66814a6f84e3a99f9f311880. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[100987c7-9f32-4a8c-93b1-9b490499b513]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD Jul 21 19:18:47 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:47 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271817978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ed9bc9-b395-42f4-9dd7-cc0b6360995f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:45Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Creating volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:47 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1073741824 Jul 21 19:18:47 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:48 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1073741824" returned: 0 in 0.849s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:48 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f Jul 21 19:18:48 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Attempting download of be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b537c-1c8c-4efc-83d5-f6e4e827d3b7]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:49 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5 Jul 21 19:18:49 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:49 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5" returned: 0 in 0.608s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5 Jul 21 19:18:50 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:50 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5" returned: 1 in 0.769s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_unipxsv5' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:18:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac3320a-9cf0-4659-844d-fcb0e588327a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:50 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD Jul 21 19:18:50 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] be5d1921-2dfc-4e84-8720-ad78553464c1 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f Jul 21 19:18:51 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Flow 'volume_create_manager' (1d637f91-a4a6-4f2f-85a1-ec62288dd5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942ea1f5-216f-419a-b396-22e348df2226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942ea1f5-216f-419a-b396-22e348df2226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231408590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929501e2-8402-40ef-b38c-fbc66a972b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bd28bc459346f49b4e344a188aa12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='77929923a0774fab826248ae1cbd4000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2796de34-b863-4d99-95cd-746a6558cbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2796de34-b863-4d99-95cd-746a6558cbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a09002-681d-4bfc-ac20-413a78347180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a09002-681d-4bfc-ac20-413a78347180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929501e2-8402-40ef-b38c-fbc66a972b2a', 'volume_name': 'volume-929501e2-8402-40ef-b38c-fbc66a972b2a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca9b1ff-6e34-44f8-947f-f016bf061d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca9b1ff-6e34-44f8-947f-f016bf061d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639a5551-cdaa-487c-a286-7342ec3f824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Volume 929501e2-8402-40ef-b38c-fbc66a972b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929501e2-8402-40ef-b38c-fbc66a972b2a', 'volume_size': 1} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-231408590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929501e2-8402-40ef-b38c-fbc66a972b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bd28bc459346f49b4e344a188aa12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:52Z,use_quota=True,user_id='77929923a0774fab826248ae1cbd4000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Creating volume 929501e2-8402-40ef-b38c-fbc66a972b2a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:51 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a 1073741824 Jul 21 19:18:51 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:52 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a 1073741824" returned: 0 in 0.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:52 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a Jul 21 19:18:52 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:53 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-2224f342-ada0-4fbc-82cf-285241b641df-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639a5551-cdaa-487c-a286-7342ec3f824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929501e2-8402-40ef-b38c-fbc66a972b2a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5d16fe-c215-4e52-be40-e3fa87c79091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "cinder-2224f342-ada0-4fbc-82cf-285241b641df-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Volume volume-929501e2-8402-40ef-b38c-fbc66a972b2a (929501e2-8402-40ef-b38c-fbc66a972b2a): created successfully Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5d16fe-c215-4e52-be40-e3fa87c79091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Flow 'volume_create_manager' (1d637f91-a4a6-4f2f-85a1-ec62288dd5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-89e4527b-4472-4039-bbd5-3caff301f098 tempest-TestMinimumBasicScenario-2030685621 None] Created volume successfully. Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" acquired by "delete_volume" :: waited 0.051s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28d13e-8f5f-403c-bfae-491668becc98]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:53 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df Jul 21 19:18:53 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" returned: 0 in 3.060s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_kbf71unodevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:18:54 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Converted 112.00 MB image at 36.54 MB/s Jul 21 19:18:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1G Jul 21 19:18:54 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:54 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df" returned: 0 in 0.975s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:54 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df Jul 21 19:18:54 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:55 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f 1G" returned: 0 in 0.731s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Downloaded image be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 for user 2f87fd5e66814a6f84e3a99f9f311880 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Marking volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2224f342-ada0-4fbc-82cf-285241b641df" returned: 0 in 0.623s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Copying metadata from image be5d1921-2dfc-4e84-8720-ad78553464c1 to 05ed9bc9-b395-42f4-9dd7-cc0b6360995f. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Creating volume glance metadata for volume 05ed9bc9-b395-42f4-9dd7-cc0b6360995f backed by image be5d1921-2dfc-4e84-8720-ad78553464c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-2224f342-ada0-4fbc-82cf-285241b641df" released by "delete_volume" :: held 1.688s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-14168b0c-9227-4716-b70e-3d6451fa2f26 req-7a757894-b3b9-4b1a-8f8b-0fcfc0f8f86e tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-14168b0c-9227-4716-b70e-3d6451fa2f26 req-7a757894-b3b9-4b1a-8f8b-0fcfc0f8f86e tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-14168b0c-9227-4716-b70e-3d6451fa2f26 req-7a757894-b3b9-4b1a-8f8b-0fcfc0f8f86e tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-14168b0c-9227-4716-b70e-3d6451fa2f26 req-7a757894-b3b9-4b1a-8f8b-0fcfc0f8f86e tempest-TestMinimumBasicScenario-2030685621 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-929501e2-8402-40ef-b38c-fbc66a972b2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09315195-395f-4b7b-8171-f79bb8245d40', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Created reservations ['5a180dc4-1355-4266-8a07-c274dbc72c8e', '673036ef-27d3-4838-90d6-0763808e4d37', 'b9a86253-e3be-4f5d-be52-85d48f17f8c9', '64248fc0-ba4c-441b-905a-381db58ff7ab'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0533fac3-6e93-401d-b525-40d72e9389fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338ab2dd-c853-4269-9b46-60654d329f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Volume volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f (05ed9bc9-b395-42f4-9dd7-cc0b6360995f): created successfully Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338ab2dd-c853-4269-9b46-60654d329f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (ab378625-d120-4da0-9c29-2786c116dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f39a5bb7-aac8-49e3-b429-b3b1aab1e1dc tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-14168b0c-9227-4716-b70e-3d6451fa2f26 req-7a757894-b3b9-4b1a-8f8b-0fcfc0f8f86e tempest-TestMinimumBasicScenario-2030685621 None] attachment_update completed successfully. Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:55 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:18:55 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:56 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.680s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:18:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Deleted volume successfully. Jul 21 19:18:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99831c25-1bd4-45c6-8db9-10abd7187f19 tempest-TestStampPattern-2099318761 None] Lock "cinder-2224f342-ada0-4fbc-82cf-285241b641df-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-ff511c41-346c-457a-8eed-7e825e9733c0-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-ff511c41-346c-457a-8eed-7e825e9733c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Deleting offline snapshot ff511c41-346c-457a-8eed-7e825e9733c0 of volume fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] snapshot_file for this snap is: volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad927b1-d138-4321-a771-031a8d751aa9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (eb79ee0e-e136-47e3-b42d-2c72b8329d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653a1adb-79c2-4620-bc5b-5fd8c0e2385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653a1adb-79c2-4620-bc5b-5fd8c0e2385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-543897969',display_name='tempest-VolumesGetTest-Volume-1139199737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbc38bd-d272-4b21-8c18-91fd57c98468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:58Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bca7c2-90b6-4fe2-a5df-f13228d0a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bca7c2-90b6-4fe2-a5df-f13228d0a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e196330-155d-44b4-aca8-f744a3c777b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:57 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:18:57 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e196330-155d-44b4-aca8-f744a3c777b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbc38bd-d272-4b21-8c18-91fd57c98468', 'volume_name': 'volume-abbc38bd-d272-4b21-8c18-91fd57c98468', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2ea0ad-7890-4e8a-8d8c-c06ff6242cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2ea0ad-7890-4e8a-8d8c-c06ff6242cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e7edf-391a-4fd4-9308-1e9e86f6d819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Volume abbc38bd-d272-4b21-8c18-91fd57c98468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbc38bd-d272-4b21-8c18-91fd57c98468', 'volume_size': 1} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-543897969',display_name='tempest-VolumesGetTest-Volume-1139199737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbc38bd-d272-4b21-8c18-91fd57c98468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef810851e0b4768a3275ddaa2d7feea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:18:58Z,use_quota=True,user_id='2f87fd5e66814a6f84e3a99f9f311880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Creating volume abbc38bd-d272-4b21-8c18-91fd57c98468 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:18:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 1073741824 Jul 21 19:18:58 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.771s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd3fde60-572a-4e1e-9f11-12d797fac88c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d996b8f-cd5e-429a-aef1-c089f4d8acb7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:18:58 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:58 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 1073741824" returned: 0 in 0.809s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:58 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 Jul 21 19:18:58 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.670s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:18:59 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:18:59 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e7edf-391a-4fd4-9308-1e9e86f6d819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbc38bd-d272-4b21-8c18-91fd57c98468', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dadef6-7463-4991-a85d-7d5be3cb7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:18:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Volume volume-abbc38bd-d272-4b21-8c18-91fd57c98468 (abbc38bd-d272-4b21-8c18-91fd57c98468): created successfully Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7dadef6-7463-4991-a85d-7d5be3cb7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Flow 'volume_create_manager' (eb79ee0e-e136-47e3-b42d-2c72b8329d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:18:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-25a44a05-ecd7-4167-b391-6b114b18e08e tempest-VolumesGetTest-58993452 None] Created volume successfully. Jul 21 19:18:59 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:18:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:18:59 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0 Jul 21 19:18:59 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-abbc38bd-d272-4b21-8c18-91fd57c98468-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "cinder-abbc38bd-d272-4b21-8c18-91fd57c98468-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-abbc38bd-d272-4b21-8c18-91fd57c98468" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:00 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-abbc38bd-d272-4b21-8c18-91fd57c98468" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c.ff511c41-346c-457a-8eed-7e825e9733c0" returned: 0 in 0.442s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b4060-1a14-45b4-8b9f-7d865dc562fd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-ff511c41-346c-457a-8eed-7e825e9733c0" released by "_delete_snapshot" :: held 2.592s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" released by "delete_snapshot" :: held 2.645s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Created reservations ['70de4c0e-d6d0-464d-aa2e-294c132f1557', 'ac2e1b9f-8b44-44a1-a4e0-c70afd410705', 'b8c02ffe-a762-4e65-8dd3-428033d7327f', '0134eb2b-6428-4ada-a8c0-dd9e399379f6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:00 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 Jul 21 19:19:00 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Delete snapshot completed successfully. Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa82fb9-d9a9-4166-8826-a79908afcaf4 tempest-TestStampPattern-2099318761 None] Lock "cinder-ff511c41-346c-457a-8eed-7e825e9733c0-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:00 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:00 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468 Jul 21 19:19:00 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-abbc38bd-d272-4b21-8c18-91fd57c98468" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-abbc38bd-d272-4b21-8c18-91fd57c98468" released by "delete_volume" :: held 0.964s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Created reservations ['0ea40dbb-57ef-4442-81b7-4c0f38e240d3', 'c5ed626d-130e-48c0-9dda-13430cfcf524', '4389a5cf-fd92-40d3-8eaa-afda1041ded9', '2eebcae0-34f4-4527-9122-346e5de5298a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:01 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:01 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:01 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:19:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8f04724-4253-4c17-8cd4-5acb54f65432 tempest-VolumesGetTest-58993452 None] Lock "cinder-abbc38bd-d272-4b21-8c18-91fd57c98468-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-05ed9bc9-b395-42f4-9dd7-cc0b6360995f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "cinder-05ed9bc9-b395-42f4-9dd7-cc0b6360995f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Acquiring lock "cinder-quobyte-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac03f11-204b-4f9b-830e-9b1077fe8f31]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f Jul 21 19:19:03 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" returned: 0 in 0.562s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:03 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f Jul 21 19:19:03 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:03 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "cinder-quobyte-05ed9bc9-b395-42f4-9dd7-cc0b6360995f" released by "delete_volume" :: held 1.052s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Created reservations ['b37ec3ce-2a18-4966-b1a3-2e5b4a4b47ab', '74e0d688-f781-4638-a9e6-3d4cb2c79a23', '88aca929-4055-45bf-a812-99c0b303aee3', 'bbaf1026-c87c-4868-bab7-e2809853f5b5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:04 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:04 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:04 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Deleted volume successfully. Jul 21 19:19:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f02faa9e-a47c-4636-8c28-ad7e3d5565f6 tempest-VolumesGetTest-58993452 None] Lock "cinder-05ed9bc9-b395-42f4-9dd7-cc0b6360995f-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-fd3fde60-572a-4e1e-9f11-12d797fac88c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "cinder-fd3fde60-572a-4e1e-9f11-12d797fac88c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Acquiring lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0ed52-1737-4add-a107-9f0aea06ac2c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:19:07 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (f84f5532-31f1-4c1e-9be0-758412c1a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965167a8-80e7-47e1-a30f-98956b350925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965167a8-80e7-47e1-a30f-98956b350925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-153718635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b8c335-514b-4d40-8000-2d0fb12b6ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:07Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c428839-0770-4c28-abdf-7d1d05cbff0a),volume_type_id=8c428839-0770-4c28-abdf-7d1d05cbff0a)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51311e6c-5d83-417a-92c4-712c92fc3210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51311e6c-5d83-417a-92c4-712c92fc3210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eef565-0dbf-41f5-a5f2-fe66f5dade19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eef565-0dbf-41f5-a5f2-fe66f5dade19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b8c335-514b-4d40-8000-2d0fb12b6ded', 'volume_name': 'volume-36b8c335-514b-4d40-8000-2d0fb12b6ded', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547fc7ab-f0bb-4c50-b555-96c1e70bc4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547fc7ab-f0bb-4c50-b555-96c1e70bc4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27842d-33bd-4df8-92fd-59b94881d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume 36b8c335-514b-4d40-8000-2d0fb12b6ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b8c335-514b-4d40-8000-2d0fb12b6ded', 'volume_size': 1} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-153718635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b8c335-514b-4d40-8000-2d0fb12b6ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:07Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c428839-0770-4c28-abdf-7d1d05cbff0a),volume_type_id=8c428839-0770-4c28-abdf-7d1d05cbff0a)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Creating volume 36b8c335-514b-4d40-8000-2d0fb12b6ded {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.680s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:07 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded 1073741824 Jul 21 19:19:07 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:07 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c Jul 21 19:19:07 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-fd3fde60-572a-4e1e-9f11-12d797fac88c" returned: 0 in 0.575s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "cinder-quobyte-fd3fde60-572a-4e1e-9f11-12d797fac88c" released by "delete_volume" :: held 1.396s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Created reservations ['7d1c12d3-d50f-4120-9616-e5c6a92b99bb', '12f01596-02af-45aa-984a-f7ef9133434f', '2a69b66a-1f0a-4329-aca2-0f0a7f21a0ba', '6b5f9a36-c589-4051-999f-a24ceebe8aed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:08 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded 1073741824" returned: 0 in 0.990s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (592d82e5-1594-4a28-bdce-411b98a07023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f055463-d98c-4256-8cc2-ff0b3c8f8c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:08 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:08 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f055463-d98c-4256-8cc2-ff0b3c8f8c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2102049771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:09Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f615b44-c807-4a6d-bf00-4d7fa2f50df6),volume_type_id=4f615b44-c807-4a6d-bf00-4d7fa2f50df6)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:08 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded Jul 21 19:19:08 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fa139c-2005-4a60-88fd-7d4fdaff0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fa139c-2005-4a60-88fd-7d4fdaff0c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2379e-17d7-4880-8f80-3d7d5156755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e2379e-17d7-4880-8f80-3d7d5156755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93', 'volume_name': 'volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdec92f-d119-4647-8350-009e9f57c8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdec92f-d119-4647-8350-009e9f57c8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b28e0e1-9778-451b-adec-95f1bc1295ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume 5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93', 'volume_size': 1} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:09 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2102049771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:09Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f615b44-c807-4a6d-bf00-4d7fa2f50df6),volume_type_id=4f615b44-c807-4a6d-bf00-4d7fa2f50df6)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Creating volume 5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:09 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 1073741824 Jul 21 19:19:09 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27842d-33bd-4df8-92fd-59b94881d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b8c335-514b-4d40-8000-2d0fb12b6ded', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1793b674-16d0-46fe-9af8-a18fad227194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume volume-36b8c335-514b-4d40-8000-2d0fb12b6ded (36b8c335-514b-4d40-8000-2d0fb12b6ded): created successfully Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1793b674-16d0-46fe-9af8-a18fad227194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (f84f5532-31f1-4c1e-9be0-758412c1a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3723aa87-ddb1-4771-b1e2-9d9baf0a80d7 tempest-TestInstancesWithCinderVolumes-177576695 None] Created volume successfully. Jul 21 19:19:09 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.976s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Deleted volume successfully. Jul 21 19:19:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eb44b2-4910-4441-bf24-7d8d82b0ed4b tempest-TestStampPattern-2099318761 None] Lock "cinder-fd3fde60-572a-4e1e-9f11-12d797fac88c-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (ae45c776-e26f-43e6-8df3-8832277a3da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70532fd-efff-423e-a6a7-4d8c6e3ca192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70532fd-efff-423e-a6a7-4d8c6e3ca192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1699237441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd92f9e4-b66a-40d2-888f-cbf2cc414558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:10Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(219367fa-fe59-486b-b3ed-b0be8722bf6c),volume_type_id=219367fa-fe59-486b-b3ed-b0be8722bf6c)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72db2611-e1e2-40f6-b767-e7d291ede143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72db2611-e1e2-40f6-b767-e7d291ede143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9f0097-00f5-4b98-a63f-3d019da9349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:19:10 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 1073741824" returned: 0 in 0.945s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:10 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 Jul 21 19:19:10 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:10 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9f0097-00f5-4b98-a63f-3d019da9349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd92f9e4-b66a-40d2-888f-cbf2cc414558', 'volume_name': 'volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558', 'volume_size': 1, 'image_id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b1466457669461b95adc46a08368eed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'created_at': datetime.datetime(2026, 7, 21, 17, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 19, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99401f5f-fb03-4777-b6b8-2e8f7f7f510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99401f5f-fb03-4777-b6b8-2e8f7f7f510c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33c79f-020e-4773-a604-99ba93463338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume dd92f9e4-b66a-40d2-888f-cbf2cc414558: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558', 'volume_size': 1, 'image_id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b1466457669461b95adc46a08368eed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'created_at': datetime.datetime(2026, 7, 21, 17, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 19, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c/file', 'properties': {}}, 'image_service': } Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Trying to clone dd92f9e4-b66a-40d2-888f-cbf2cc414558 from image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b28e0e1-9778-451b-adec-95f1bc1295ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac466efb-9316-427d-8d68-49b4b04c4501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 (5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93): created successfully Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac466efb-9316-427d-8d68-49b4b04c4501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (592d82e5-1594-4a28-bdce-411b98a07023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a4eb9225-5218-4759-9fb6-c99d85a6cf89 tempest-TestInstancesWithCinderVolumes-177576695 None] Created volume successfully. Jul 21 19:19:14 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD, size 20.69 MB, duration 4.11 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:19:14 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Image download 20.69 MB at 5.03 MB/s Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a9f4ed-0684-4702-9327-dff02eed2918]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD Jul 21 19:19:15 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:15 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Temporary image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c is fetched for user c21a154809874973a92398c534ffac13. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39038554-a78f-43e4-84b7-5d6671033c3f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:15 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD Jul 21 19:19:15 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1699237441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd92f9e4-b66a-40d2-888f-cbf2cc414558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1466457669461b95adc46a08368eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:10Z,use_quota=True,user_id='c21a154809874973a92398c534ffac13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(219367fa-fe59-486b-b3ed-b0be8722bf6c),volume_type_id=219367fa-fe59-486b-b3ed-b0be8722bf6c)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Creating volume dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:16 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1073741824 Jul 21 19:19:16 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:16 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1073741824" returned: 0 in 0.710s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:16 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 Jul 21 19:19:16 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Attempting download of 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c ((None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}])) to volume dd92f9e4-b66a-40d2-888f-cbf2cc414558. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4357b69-766a-4f07-9e24-3c2d9beffc9d]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10 Jul 21 19:19:17 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:17 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10 Jul 21 19:19:17 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:17 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10" returned: 1 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_d4i_0g10' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba421cbe-9851-40a4-a3ac-0bab14cbe8a6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD Jul 21 19:19:18 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:18 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:18 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:19:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:18 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 Jul 21 19:19:18 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:20 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558" returned: 0 in 2.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:20 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20c7e1bb-670e-484a-a1f2-f798e8d2cb2c_m0lubhxgdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:19:20 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Converted 112.00 MB image at 46.09 MB/s Jul 21 19:19:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:20 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1G Jul 21 19:19:20 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:21 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 1G" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Downloaded image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c ((None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}])) to volume dd92f9e4-b66a-40d2-888f-cbf2cc414558 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Temporary image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c for user c21a154809874973a92398c534ffac13 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Marking volume dd92f9e4-b66a-40d2-888f-cbf2cc414558 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Copying metadata from image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c to dd92f9e4-b66a-40d2-888f-cbf2cc414558. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Creating volume glance metadata for volume dd92f9e4-b66a-40d2-888f-cbf2cc414558 backed by image 20c7e1bb-670e-484a-a1f2-f798e8d2cb2c with: {'image_id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'image_name': 'tempest-scenario-img--1401219', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da33c79f-020e-4773-a604-99ba93463338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558', 'volume_size': 1, 'image_id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b1466457669461b95adc46a08368eed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '20c7e1bb-670e-484a-a1f2-f798e8d2cb2c', 'created_at': datetime.datetime(2026, 7, 21, 17, 19, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 19, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20c7e1bb-670e-484a-a1f2-f798e8d2cb2c/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205eb1dd-3304-45c3-9cdb-557ebb94fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Volume volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 (dd92f9e4-b66a-40d2-888f-cbf2cc414558): created successfully Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205eb1dd-3304-45c3-9cdb-557ebb94fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Flow 'volume_create_manager' (ae45c776-e26f-43e6-8df3-8832277a3da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e89c8f6-fee6-4ed5-aa1e-d571b29fcea7 tempest-TestInstancesWithCinderVolumes-177576695 None] Created volume successfully. Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (2328e76d-35d2-400b-a06b-27fc530bdafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ba88c-f946-4cc3-8988-2f45ae8e99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ba88c-f946-4cc3-8988-2f45ae8e99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954528917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dc16ab-a68c-44de-b358-60a97bce92f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:24Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eadd9a4-c3b8-4f63-bf18-d8a6e1ccf655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eadd9a4-c3b8-4f63-bf18-d8a6e1ccf655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cae3dc-2e10-4e0c-a8f3-ea6dbf8a988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cae3dc-2e10-4e0c-a8f3-ea6dbf8a988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97dc16ab-a68c-44de-b358-60a97bce92f2', 'volume_name': 'volume-97dc16ab-a68c-44de-b358-60a97bce92f2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5566654-0869-4b75-a57c-ce9896f1f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5566654-0869-4b75-a57c-ce9896f1f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d9fcd6-8321-459a-94e4-fd2d3403d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Volume 97dc16ab-a68c-44de-b358-60a97bce92f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97dc16ab-a68c-44de-b358-60a97bce92f2', 'volume_size': 1} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954528917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97dc16ab-a68c-44de-b358-60a97bce92f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:24Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Creating volume 97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:24 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 1073741824 Jul 21 19:19:24 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:25 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 1073741824" returned: 0 in 1.073s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:25 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:25 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:25 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 Jul 21 19:19:25 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:26 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:19:26 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2" returned: 0 in 0.818s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d9fcd6-8321-459a-94e4-fd2d3403d447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97dc16ab-a68c-44de-b358-60a97bce92f2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f0937-0d74-4620-88a5-01ba9959e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Volume volume-97dc16ab-a68c-44de-b358-60a97bce92f2 (97dc16ab-a68c-44de-b358-60a97bce92f2): created successfully Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f0937-0d74-4620-88a5-01ba9959e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (2328e76d-35d2-400b-a06b-27fc530bdafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f246b486-f843-4e75-96bc-b7e9a30f5290 tempest-VolumesSnapshotTestJSON-980902159 None] Created volume successfully. Jul 21 19:19:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18283ccc-02f3-4120-86f6-771b07fe2b3e req-bd74043d-7962-4164-acca-b35f98718dc8 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18283ccc-02f3-4120-86f6-771b07fe2b3e req-bd74043d-7962-4164-acca-b35f98718dc8 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18283ccc-02f3-4120-86f6-771b07fe2b3e req-bd74043d-7962-4164-acca-b35f98718dc8 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-18283ccc-02f3-4120-86f6-771b07fe2b3e req-bd74043d-7962-4164-acca-b35f98718dc8 tempest-TestInstancesWithCinderVolumes-177576695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdd27430-7c73-4eb9-8e9d-01f8b4c76480', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:19:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-18283ccc-02f3-4120-86f6-771b07fe2b3e req-bd74043d-7962-4164-acca-b35f98718dc8 tempest-TestInstancesWithCinderVolumes-177576695 None] attachment_update completed successfully. Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (818bca91-5100-426c-b294-4c8c61100e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f139d-f45a-41a4-b9b6-b74f9170aa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f139d-f45a-41a4-b9b6-b74f9170aa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702896550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b25c5df-4c2f-4a75-8fa4-abf3de270e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:28Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6e349-84d8-4e36-bdd0-48dfd7247a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6e349-84d8-4e36-bdd0-48dfd7247a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de9bf86-8b12-43ef-b59c-fc7bded605b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de9bf86-8b12-43ef-b59c-fc7bded605b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b25c5df-4c2f-4a75-8fa4-abf3de270e04', 'volume_name': 'volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6d03ea-b853-4ac0-a051-3c6c16353809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6d03ea-b853-4ac0-a051-3c6c16353809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0de45e0-26db-45d8-9cf4-95ffb2a7c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Volume 1b25c5df-4c2f-4a75-8fa4-abf3de270e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04', 'volume_size': 1} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702896550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b25c5df-4c2f-4a75-8fa4-abf3de270e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:28Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Creating volume 1b25c5df-4c2f-4a75-8fa4-abf3de270e04 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:28 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 1073741824 Jul 21 19:19:28 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:29 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 1073741824" returned: 0 in 1.019s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:29 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 Jul 21 19:19:29 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:30 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" returned: 0 in 0.626s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=100,cinder:SELECT=93,cinder:INSERT=36,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0de45e0-26db-45d8-9cf4-95ffb2a7c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d863a3-1bd8-4fc6-90ff-b9ac65e4d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Creating offline snapshot 9351f663-fdae-41a3-97d0-ee811ad3f246 of volume 97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Volume volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 (1b25c5df-4c2f-4a75-8fa4-abf3de270e04): created successfully Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d863a3-1bd8-4fc6-90ff-b9ac65e4d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (818bca91-5100-426c-b294-4c8c61100e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d53dc72-4d6b-4276-ba74-f89c38f29ed0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f112f93c-1765-4f48-96db-023251263838 tempest-CreateVolumesFromImageTest-1114023975 None] Created volume successfully. Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (b0f606fd-50f4-407c-9854-39cb7f4cf5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc215768-2af0-4cf6-9472-56888c4e5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 Jul 21 19:19:30 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc215768-2af0-4cf6-9472-56888c4e5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116796237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2526b766-ad56-48d4-8cd9-62eac5e402f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:30Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b86f081-f49b-4f37-b7a4-6512392f8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b86f081-f49b-4f37-b7a4-6512392f8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d1fb90-2f00-42d0-a899-8963fb24a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d1fb90-2f00-42d0-a899-8963fb24a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2526b766-ad56-48d4-8cd9-62eac5e402f4', 'volume_name': 'volume-2526b766-ad56-48d4-8cd9-62eac5e402f4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe4cbf-8ba2-4976-ba6b-711c8d296775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe4cbf-8ba2-4976-ba6b-711c8d296775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9baa3c-f961-44bf-b350-06ad0e79a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Volume 2526b766-ad56-48d4-8cd9-62eac5e402f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2526b766-ad56-48d4-8cd9-62eac5e402f4', 'volume_size': 1} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:30 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (ac76b147-80b5-4dbe-b2e6-2fa191a071f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456a8b18-aba5-42aa-9379-692d221b36a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456a8b18-aba5-42aa-9379-692d221b36a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974085901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21798263-ac23-40b1-8f27-ed987ddd078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:30Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67284dfb-db2e-4e31-ab65-ab9863d10cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67284dfb-db2e-4e31-ab65-ab9863d10cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875b9207-f061-4942-9b24-8c89b760c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875b9207-f061-4942-9b24-8c89b760c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21798263-ac23-40b1-8f27-ed987ddd078f', 'volume_name': 'volume-21798263-ac23-40b1-8f27-ed987ddd078f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd847e99-b9b3-4a00-ba43-95ec6ef813f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd847e99-b9b3-4a00-ba43-95ec6ef813f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eef7d4-b81b-4e8f-b19d-14bf9cb3b630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Volume 21798263-ac23-40b1-8f27-ed987ddd078f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21798263-ac23-40b1-8f27-ed987ddd078f', 'volume_size': 1} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (1f4ee0d9-0f49-4cc6-ac05-f2faf7474920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bbd912-ee6b-45f4-a0a9-e5180d0ee67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bbd912-ee6b-45f4-a0a9-e5180d0ee67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850465961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f88de25-5e64-4c71-9f85-0619fc1275d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:31Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a518114f-f612-45de-bf6d-cfd6e31b0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a518114f-f612-45de-bf6d-cfd6e31b0f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007c988e-73b6-4f1e-9dfd-4d5cce0c7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007c988e-73b6-4f1e-9dfd-4d5cce0c7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f88de25-5e64-4c71-9f85-0619fc1275d4', 'volume_name': 'volume-8f88de25-5e64-4c71-9f85-0619fc1275d4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393d2ebe-bb4c-4ec4-a724-26adf1ea9be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393d2ebe-bb4c-4ec4-a724-26adf1ea9be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf820ed8-5d87-4970-bf8c-32827f2b99d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Volume 8f88de25-5e64-4c71-9f85-0619fc1275d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f88de25-5e64-4c71-9f85-0619fc1275d4', 'volume_size': 1} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2" returned: 0 in 0.936s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:31 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 1G Jul 21 19:19:31 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (cc5110a5-d809-434d-b22e-d21b0cd46295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1be205-954a-4e83-a662-0c850b06edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=101,cinder:SELECT=100,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1be205-954a-4e83-a662-0c850b06edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440964308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91d8408-183d-42e5-bd7a-319fec141ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:31Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b011bdc5-3946-4388-a5d3-322b96417167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b011bdc5-3946-4388-a5d3-322b96417167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cba84c-5338-4691-b939-79f7f8006e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cba84c-5338-4691-b939-79f7f8006e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91d8408-183d-42e5-bd7a-319fec141ff9', 'volume_name': 'volume-c91d8408-183d-42e5-bd7a-319fec141ff9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f2a0ec-613e-4b56-8a6c-9615ef8a69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f2a0ec-613e-4b56-8a6c-9615ef8a69ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434db394-0c03-4edb-a297-3473ecc27f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Volume c91d8408-183d-42e5-bd7a-319fec141ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91d8408-183d-42e5-bd7a-319fec141ff9', 'volume_size': 1} Jul 21 19:19:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:32 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 1G" returned: 0 in 0.833s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dc16ab-a68c-44de-b358-60a97bce92f2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dc16ab-a68c-44de-b358-60a97bce92f2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 Jul 21 19:19:32 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:32 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97dc16ab-a68c-44de-b358-60a97bce92f2 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 is being set with open permissions: ugo+rw Jul 21 19:19:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:32 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 Jul 21 19:19:32 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info Jul 21 19:19:33 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info is being set with open permissions: ugo+rw Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info Jul 21 19:19:33 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:33 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.info" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.627s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116796237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2526b766-ad56-48d4-8cd9-62eac5e402f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:30Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Creating volume 2526b766-ad56-48d4-8cd9-62eac5e402f4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:33 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 1073741824 Jul 21 19:19:33 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d72520b6-228f-4f80-b297-bbceb0d1134c tempest-VolumesSnapshotTestJSON-980902159 None] Create snapshot completed successfully Jul 21 19:19:34 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 1073741824" returned: 0 in 0.789s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:34 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 Jul 21 19:19:34 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-9351f663-fdae-41a3-97d0-ee811ad3f246-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9351f663-fdae-41a3-97d0-ee811ad3f246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:35 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4" returned: 0 in 0.516s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.114s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974085901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21798263-ac23-40b1-8f27-ed987ddd078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:30Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Creating volume 21798263-ac23-40b1-8f27-ed987ddd078f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9baa3c-f961-44bf-b350-06ad0e79a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2526b766-ad56-48d4-8cd9-62eac5e402f4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246f6237-61c8-49be-b3d7-3ffafa6adef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:35 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f 1073741824 Jul 21 19:19:35 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Volume volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 (2526b766-ad56-48d4-8cd9-62eac5e402f4): created successfully Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246f6237-61c8-49be-b3d7-3ffafa6adef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (b0f606fd-50f4-407c-9854-39cb7f4cf5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-64bc3748-5b91-4436-b7eb-e56fc88b07e4 tempest-CreateVolumesFromImageTest-1114023975 None] Created volume successfully. Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-9351f663-fdae-41a3-97d0-ee811ad3f246" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9351f663-fdae-41a3-97d0-ee811ad3f246" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Deleting offline snapshot 9351f663-fdae-41a3-97d0-ee811ad3f246 of volume 97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] snapshot_file for this snap is: volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2dbe36-297f-4b57-8852-e7bbf7a164eb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:35 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 Jul 21 19:19:35 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f 1073741824" returned: 0 in 0.837s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97dc16ab-a68c-44de-b358-60a97bce92f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:36 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f Jul 21 19:19:36 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66a0f0-2fc3-43e1-8f22-d27cefa43ccb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 Jul 21 19:19:36 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.387s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850465961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f88de25-5e64-4c71-9f85-0619fc1275d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:31Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Creating volume 8f88de25-5e64-4c71-9f85-0619fc1275d4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:36 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 1073741824 Jul 21 19:19:36 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9eef7d4-b81b-4e8f-b19d-14bf9cb3b630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21798263-ac23-40b1-8f27-ed987ddd078f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af5c49b-58e6-4b91-9bcd-9f47a4b9d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Volume volume-21798263-ac23-40b1-8f27-ed987ddd078f (21798263-ac23-40b1-8f27-ed987ddd078f): created successfully Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af5c49b-58e6-4b91-9bcd-9f47a4b9d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (ac76b147-80b5-4dbe-b2e6-2fa191a071f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-173b9d6e-4d8f-4319-a81e-2abc771ad821 tempest-CreateVolumesFromImageTest-1114023975 None] Created volume successfully. Jul 21 19:19:37 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2" returned: 0 in 0.755s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 Jul 21 19:19:37 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246" returned: 0 in 0.609s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 1073741824" returned: 0 in 0.904s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:37 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246 Jul 21 19:19:37 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:37 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 Jul 21 19:19:37 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.583s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440964308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91d8408-183d-42e5-bd7a-319fec141ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc332e75ec264a4082df341086258840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:31Z,use_quota=True,user_id='e4a2308164934863bd34cc8969f07aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Creating volume c91d8408-183d-42e5-bd7a-319fec141ff9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2.9351f663-fdae-41a3-97d0-ee811ad3f246" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf820ed8-5d87-4970-bf8c-32827f2b99d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f88de25-5e64-4c71-9f85-0619fc1275d4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:38 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 1073741824 Jul 21 19:19:38 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb7178e-e61d-43da-9a0e-b2e12aa7a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Volume volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 (8f88de25-5e64-4c71-9f85-0619fc1275d4): created successfully Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb7178e-e61d-43da-9a0e-b2e12aa7a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (1f4ee0d9-0f49-4cc6-ac05-f2faf7474920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9351f663-fdae-41a3-97d0-ee811ad3f246" released by "_delete_snapshot" :: held 2.867s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9a9ac541-38d5-4da2-bdad-7aa6b3ce8d22 tempest-CreateVolumesFromImageTest-1114023975 None] Created volume successfully. Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" released by "delete_snapshot" :: held 2.919s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['2ba20b35-aa54-4040-a9cc-5f1ca61541c9', '3db8e738-4148-4258-84ce-5722b7a646f4', '5537d0c3-d69e-4ba0-b158-5ac8d431d256', 'ffce5305-bdf1-49c7-8d8d-0f3708977a6e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Delete snapshot completed successfully. Jul 21 19:19:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b22f49c5-2de3-4f43-9094-7a88d03b3ea5 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9351f663-fdae-41a3-97d0-ee811ad3f246-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:39 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 1073741824" returned: 0 in 0.844s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:39 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 Jul 21 19:19:39 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:39 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9" returned: 0 in 0.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434db394-0c03-4edb-a297-3473ecc27f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91d8408-183d-42e5-bd7a-319fec141ff9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d73ab-9924-44f8-a7c6-2d1ba89ed4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Volume volume-c91d8408-183d-42e5-bd7a-319fec141ff9 (c91d8408-183d-42e5-bd7a-319fec141ff9): created successfully Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d73ab-9924-44f8-a7c6-2d1ba89ed4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Flow 'volume_create_manager' (cc5110a5-d809-434d-b22e-d21b0cd46295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0a6aaa58-81b7-497e-8b2c-353e969537b7 tempest-CreateVolumesFromImageTest-1114023975 None] Created volume successfully. Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (30d6b9ec-b37d-4dec-a990-33e0666364b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa714238-94fd-4046-8251-e260be20f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa714238-94fd-4046-8251-e260be20f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1972731383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea0d059-f625-49fa-9902-a15c326e34d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:40Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce82a306-fd0c-4fe4-b8ef-ea18819680a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce82a306-fd0c-4fe4-b8ef-ea18819680a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5163c7-98cf-4517-a153-88f892cf1045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5163c7-98cf-4517-a153-88f892cf1045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea0d059-f625-49fa-9902-a15c326e34d0', 'volume_name': 'volume-aea0d059-f625-49fa-9902-a15c326e34d0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7ff09d-b425-4b68-b708-45b54b565765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7ff09d-b425-4b68-b708-45b54b565765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa32a96e-a1e6-4217-83a3-8ec5a84850c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Volume aea0d059-f625-49fa-9902-a15c326e34d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea0d059-f625-49fa-9902-a15c326e34d0', 'volume_size': 1} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1972731383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea0d059-f625-49fa-9902-a15c326e34d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:40Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Creating volume aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:40 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:40 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 1073741824 Jul 21 19:19:40 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-c91d8408-183d-42e5-bd7a-319fec141ff9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-c91d8408-183d-42e5-bd7a-319fec141ff9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-quobyte-c91d8408-183d-42e5-bd7a-319fec141ff9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-c91d8408-183d-42e5-bd7a-319fec141ff9" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[975f0b15-6a38-45fe-be38-16e13534c317]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 Jul 21 19:19:41 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 1073741824" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:19:41 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9 Jul 21 19:19:41 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa32a96e-a1e6-4217-83a3-8ec5a84850c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea0d059-f625-49fa-9902-a15c326e34d0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f705fe-25d9-4edd-b6f6-b33c7271c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Volume volume-aea0d059-f625-49fa-9902-a15c326e34d0 (aea0d059-f625-49fa-9902-a15c326e34d0): created successfully Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f705fe-25d9-4edd-b6f6-b33c7271c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (30d6b9ec-b37d-4dec-a990-33e0666364b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b2db6847-3e66-4c59-99c3-e5df16774030 tempest-VolumesSnapshotTestJSON-980902159 None] Created volume successfully. Jul 21 19:19:41 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c91d8408-183d-42e5-bd7a-319fec141ff9" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-c91d8408-183d-42e5-bd7a-319fec141ff9" released by "delete_volume" :: held 0.890s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Created reservations ['4f8138cb-87e5-4f1b-ae6c-bfd1a5e27b3d', 'a2220006-cd31-4145-acd9-31b2621119ff', '33f8697f-e477-402e-ba0d-f8f4d41e4ba6', 'a5666894-e500-4f9e-9c3d-768cd5e3f10f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:41 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:41 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-8f88de25-5e64-4c71-9f85-0619fc1275d4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-8f88de25-5e64-4c71-9f85-0619fc1275d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-quobyte-8f88de25-5e64-4c71-9f85-0619fc1275d4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-8f88de25-5e64-4c71-9f85-0619fc1275d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f834922-2141-4e0c-9463-923a4bb3a0bc]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Deleted volume successfully. Jul 21 19:19:42 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 Jul 21 19:19:42 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30d9713d-3c44-4eb8-98ac-d651a571ea22 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-c91d8408-183d-42e5-bd7a-319fec141ff9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:42 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:42 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4 Jul 21 19:19:42 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Creating offline snapshot 9e67dab3-5088-43e3-b939-db41ed09982f of volume aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b230e-6843-4b84-8a89-4a995608246b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:19:43 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8f88de25-5e64-4c71-9f85-0619fc1275d4" returned: 0 in 0.571s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-8f88de25-5e64-4c71-9f85-0619fc1275d4" released by "delete_volume" :: held 1.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Created reservations ['9e413f6c-8aa2-425b-b3f0-c0a18020269e', 'a8e4357f-86d2-42ad-af3a-39ddbb3a7f12', '1b3eff3b-3af6-4e32-b5fd-726fff92d0ba', 'b1f03022-6799-4a45-878e-cd6fa800f41d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:43 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.749s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:43 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f 1G Jul 21 19:19:43 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:43 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Deleted volume successfully. Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87fcf298-63e5-4050-b2c8-75973e7387ba tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-8f88de25-5e64-4c71-9f85-0619fc1275d4-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-2526b766-ad56-48d4-8cd9-62eac5e402f4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-2526b766-ad56-48d4-8cd9-62eac5e402f4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-quobyte-2526b766-ad56-48d4-8cd9-62eac5e402f4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-2526b766-ad56-48d4-8cd9-62eac5e402f4" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931c9a9-f47b-425c-9ab2-7b713daf4415]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f 1G" returned: 0 in 0.976s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0d059-f625-49fa-9902-a15c326e34d0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:44 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0d059-f625-49fa-9902-a15c326e34d0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:19:44 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:44 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 Jul 21 19:19:44 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea0d059-f625-49fa-9902-a15c326e34d0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f is being set with open permissions: ugo+rw Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:19:45 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4" returned: 0 in 0.674s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4 Jul 21 19:19:45 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info Jul 21 19:19:45 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2526b766-ad56-48d4-8cd9-62eac5e402f4" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-2526b766-ad56-48d4-8cd9-62eac5e402f4" released by "delete_volume" :: held 1.144s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Created reservations ['099169fc-637b-43b7-82bd-b8bb05ba95a8', 'cdd44c81-fae3-402d-ba07-22d9316f67bb', '6fa93f33-ac2c-4b43-9c67-c47b021008f3', '6a5e1c97-71bf-4226-826b-2ce3124cb977'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:45 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:45 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info is being set with open permissions: ugo+rw Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:45 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info Jul 21 19:19:45 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:45 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:45 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:46 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.info" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.343s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bd71bb37-314a-45e9-b95d-19f3c39b11e6 tempest-VolumesSnapshotTestJSON-980902159 None] Create snapshot completed successfully Jul 21 19:19:46 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Deleted volume successfully. Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-530660ad-99b4-48a6-8034-c21cecab4b3b tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-2526b766-ad56-48d4-8cd9-62eac5e402f4-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-21798263-ac23-40b1-8f27-ed987ddd078f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-21798263-ac23-40b1-8f27-ed987ddd078f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-quobyte-21798263-ac23-40b1-8f27-ed987ddd078f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-21798263-ac23-40b1-8f27-ed987ddd078f" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe324013-9534-47c6-9f0a-a8db0e082874]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f Jul 21 19:19:47 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f" returned: 0 in 0.591s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:47 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f Jul 21 19:19:47 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:47 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-21798263-ac23-40b1-8f27-ed987ddd078f" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-21798263-ac23-40b1-8f27-ed987ddd078f" released by "delete_volume" :: held 0.976s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (0cb18296-98ee-4dc3-934b-ecae3cdcb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6043df-2da9-4160-8f36-04ccced52e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6043df-2da9-4160-8f36-04ccced52e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1727754048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feabbd3c-bf15-420f-9555-00c9261700e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9e67dab3-5088-43e3-b939-db41ed09982f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:48Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd37412-acb2-4146-b8de-cf50d7f80104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd37412-acb2-4146-b8de-cf50d7f80104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5c6aae-a828-41be-9995-7cb168ea39c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5c6aae-a828-41be-9995-7cb168ea39c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'feabbd3c-bf15-420f-9555-00c9261700e8', 'volume_name': 'volume-feabbd3c-bf15-420f-9555-00c9261700e8', 'volume_size': 2, 'snapshot_id': '9e67dab3-5088-43e3-b939-db41ed09982f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2282662-69e3-481a-a5cb-7d3c6b2672ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2282662-69e3-481a-a5cb-7d3c6b2672ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5faca8-9da6-476f-b81c-8520fa880c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Volume feabbd3c-bf15-420f-9555-00c9261700e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-feabbd3c-bf15-420f-9555-00c9261700e8', 'volume_size': 2, 'snapshot_id': '9e67dab3-5088-43e3-b939-db41ed09982f'} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Created reservations ['5d2a7570-1755-40b5-91fe-6f6971d3149a', '59c12dd7-74e4-4963-bc6d-cdbb4736a057', 'ce013820-fa40-4b6c-9acc-465ba9075f1f', '0e1fc2cc-9d4c-49f1-8d5b-0f360773fc95'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f-feabbd3c-bf15-420f-9555-00c9261700e8" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f-feabbd3c-bf15-420f-9555-00c9261700e8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Creating volume feabbd3c-bf15-420f-9555-00c9261700e8 from snapshot 9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] snapshot: 9e67dab3-5088-43e3-b939-db41ed09982f, volume: feabbd3c-bf15-420f-9555-00c9261700e8, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[466805b5-6125-42f8-88bb-831d1eea51a6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:48 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:19:48 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:48 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.578s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea0d059-f625-49fa-9902-a15c326e34d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Deleted volume successfully. Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc9cc4-06a0-411b-89c7-8e1102994c9c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c330dcff-8d55-4c11-a5e5-1993b9e98f24 tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-21798263-ac23-40b1-8f27-ed987ddd078f-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:49 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:19:49 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-1b25c5df-4c2f-4a75-8fa4-abf3de270e04-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-1b25c5df-4c2f-4a75-8fa4-abf3de270e04-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-086fb082-7dd1-4ed3-a4f9-db8309907efc req-68e5cd17-c95a-4335-864a-d4ca04ed55f8 tempest-TestMinimumBasicScenario-2030685621 None] Terminate volume connection completed successfully. Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-086fb082-7dd1-4ed3-a4f9-db8309907efc req-68e5cd17-c95a-4335-864a-d4ca04ed55f8 tempest-TestMinimumBasicScenario-2030685621 None] Deleting attachment 09315195-395f-4b7b-8171-f79bb8245d40. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "cinder-quobyte-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762d843-e458-4588-9c86-8c0b2b76aec2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 Jul 21 19:19:49 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 Jul 21 19:19:49 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:49 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" returned: 0 in 0.486s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:49 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04 Jul 21 19:19:49 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "cinder-929501e2-8402-40ef-b38c-fbc66a972b2a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "cinder-929501e2-8402-40ef-b38c-fbc66a972b2a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "cinder-quobyte-929501e2-8402-40ef-b38c-fbc66a972b2a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "cinder-quobyte-929501e2-8402-40ef-b38c-fbc66a972b2a" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5edbcc-5e81-4bb4-b22b-749d322a2fe1]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:50 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" returned: 0 in 0.609s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-quobyte-1b25c5df-4c2f-4a75-8fa4-abf3de270e04" released by "delete_volume" :: held 1.216s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:50 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a Jul 21 19:19:50 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Created reservations ['3f21f63c-47c1-49d2-b99b-7680a17881e3', '673afe5c-80e3-48e7-a72a-753ea5877371', '07bbd35f-299a-482d-a6ce-e3b8e536bdaf', 'e99a34cd-3f7b-4b35-b0fe-fd9b38816eee'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:51 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a" returned: 0 in 1.073s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:51 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a Jul 21 19:19:51 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:51 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.551s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Deleted volume successfully. Jul 21 19:19:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6d22d9e-49d0-4f2b-b767-4b2952ad7b4d tempest-CreateVolumesFromImageTest-1114023975 None] Lock "cinder-1b25c5df-4c2f-4a75-8fa4-abf3de270e04-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:51 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-929501e2-8402-40ef-b38c-fbc66a972b2a" returned: 0 in 0.678s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "cinder-quobyte-929501e2-8402-40ef-b38c-fbc66a972b2a" released by "delete_volume" :: held 1.876s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Created reservations ['85619f5d-9214-4c2e-a3d5-24212ec274dd', '699007df-64e4-4401-b0ad-6910ceada1b0', '47602748-9504-4915-b3b7-f199015271bd', 'fb2f8bc0-2184-41e9-b065-91536ce8787e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:52 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:52 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:53 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.832s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Deleted volume successfully. Jul 21 19:19:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc5ad948-dfbc-438b-83b3-9934a4ddddb1 tempest-TestMinimumBasicScenario-2030685621 None] Lock "cinder-929501e2-8402-40ef-b38c-fbc66a972b2a-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:55 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8" returned: 0 in 6.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c64cc0-1ddd-4174-8948-a023a2f18b40]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:19:56 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:19:56 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Converted 1024.00 MB image at 162.22 MB/s Jul 21 19:19:56 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 is being set with open permissions: ugo+rw Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:56 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 Jul 21 19:19:56 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:56 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" released by "_copy_volume_from_snapshot" :: held 8.639s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f-feabbd3c-bf15-420f-9555-00c9261700e8" released by "_create_volume_from_snapshot" :: held 8.708s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.732s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5faca8-9da6-476f-b81c-8520fa880c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feabbd3c-bf15-420f-9555-00c9261700e8', 'volume_size': 2, 'snapshot_id': '9e67dab3-5088-43e3-b939-db41ed09982f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ba64a0-731b-48df-bb44-7bc38b99643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Volume volume-feabbd3c-bf15-420f-9555-00c9261700e8 (feabbd3c-bf15-420f-9555-00c9261700e8): created successfully Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ba64a0-731b-48df-bb44-7bc38b99643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (0cb18296-98ee-4dc3-934b-ecae3cdcb121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-47868c58-3089-4eeb-9e59-133fadf01178 tempest-VolumesSnapshotTestJSON-980902159 None] Created volume successfully. Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-feabbd3c-bf15-420f-9555-00c9261700e8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-feabbd3c-bf15-420f-9555-00c9261700e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[91daf808-6868-463a-993c-d92b7d99543e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 Jul 21 19:19:58 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:58 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8 Jul 21 19:19:58 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:58 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-feabbd3c-bf15-420f-9555-00c9261700e8" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-feabbd3c-bf15-420f-9555-00c9261700e8" released by "delete_volume" :: held 0.792s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['bc2539e7-a943-4f27-9df0-11e7890c0587', '6299c4e3-1792-4b71-91ee-375639c99776', 'e09b6684-89de-4302-8c95-967b4ee85921', '15080123-e5f9-4e3a-859c-846d83dc9c1c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:19:59 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (c141b1eb-446c-404a-ae66-ecc9bf82a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e753a7-956f-4ee8-aa43-fd4afe1d4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e753a7-956f-4ee8-aa43-fd4afe1d4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070488220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcc20bf-9180-4e29-b1c8-0d54c292c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:59Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea465e4-b2aa-46db-8888-64a714be292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea465e4-b2aa-46db-8888-64a714be292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cc6bd6-2e48-4a29-be89-832686249f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cc6bd6-2e48-4a29-be89-832686249f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dcc20bf-9180-4e29-b1c8-0d54c292c547', 'volume_name': 'volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab45af09-c81c-4297-b50e-534fc9c937e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab45af09-c81c-4297-b50e-534fc9c937e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b52f860-3c14-4b8f-ba78-f6991eb3c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:19:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Volume 1dcc20bf-9180-4e29-b1c8-0d54c292c547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547', 'volume_size': 1} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070488220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dcc20bf-9180-4e29-b1c8-0d54c292c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:19:59Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Creating volume 1dcc20bf-9180-4e29-b1c8-0d54c292c547 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:19:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 1073741824 Jul 21 19:19:59 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-9e67dab3-5088-43e3-b939-db41ed09982f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9e67dab3-5088-43e3-b939-db41ed09982f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:19:59 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Deleting offline snapshot 9e67dab3-5088-43e3-b939-db41ed09982f of volume aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] snapshot_file for this snap is: volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:19:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Deleted volume successfully. Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5782266f-3c93-4cdb-957f-02838a1d34be]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-06102c7c-5f80-4c1c-ad5a-5e61a47ff1f6 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-feabbd3c-bf15-420f-9555-00c9261700e8-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:19:59 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:19:59 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:19:59 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 21 19:19:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 1073741824" returned: 0 in 0.682s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea0d059-f625-49fa-9902-a15c326e34d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd629425-a59c-4a5d-a4ba-6a6f07fadf86]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 Jul 21 19:20:00 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:00 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:20:00 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:00 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b52f860-3c14-4b8f-ba78-f6991eb3c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032b25fb-7545-4840-85eb-d26b1e72911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Volume volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 (1dcc20bf-9180-4e29-b1c8-0d54c292c547): created successfully Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032b25fb-7545-4840-85eb-d26b1e72911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (c141b1eb-446c-404a-ae66-ecc9bf82a164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0c692024-ebca-436a-a494-747535e09dc6 tempest-ProjectReaderTests-868703340 None] Created volume successfully. Jul 21 19:20:00 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:20:00 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:00 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:00 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f Jul 21 19:20:00 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0.9e67dab3-5088-43e3-b939-db41ed09982f" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e67dab3-5088-43e3-b939-db41ed09982f" released by "_delete_snapshot" :: held 1.719s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" released by "delete_snapshot" :: held 1.762s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['f0f73c15-cd91-47ec-8681-f11e04dab09c', 'e3e19861-5db3-45de-8715-3bd8876bbbb2', '057ae936-951b-4ae9-9cae-694743767857', '3b8787fc-c3a8-49ca-af47-7e925ca5220b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Delete snapshot completed successfully. Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ef5151a-c1cf-4944-a225-93f493357d47 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9e67dab3-5088-43e3-b939-db41ed09982f-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-1dcc20bf-9180-4e29-b1c8-0d54c292c547-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "cinder-1dcc20bf-9180-4e29-b1c8-0d54c292c547-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-quobyte-1dcc20bf-9180-4e29-b1c8-0d54c292c547" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-1dcc20bf-9180-4e29-b1c8-0d54c292c547" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee071b9-9d4c-4417-a38a-f89d301c7636]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-aea0d059-f625-49fa-9902-a15c326e34d0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-aea0d059-f625-49fa-9902-a15c326e34d0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:01 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 Jul 21 19:20:01 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cfbabf-ad60-4e6a-b189-9e7333d99502]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:20:02 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547" returned: 0 in 0.523s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547 Jul 21 19:20:02 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1dcc20bf-9180-4e29-b1c8-0d54c292c547" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0 Jul 21 19:20:02 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-1dcc20bf-9180-4e29-b1c8-0d54c292c547" released by "delete_volume" :: held 0.980s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Created reservations ['2f4f5a1b-c7cc-4951-a756-26ec6410cc51', '1b16a09d-d049-4215-bcbf-dfedda93f722', '61917b4e-caf9-476b-8645-d398abd48a88', '84c935fe-7531-465d-b281-193b4a80911d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:02 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:02 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:02 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aea0d059-f625-49fa-9902-a15c326e34d0" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-aea0d059-f625-49fa-9902-a15c326e34d0" released by "delete_volume" :: held 1.070s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['f6ad672d-047e-4978-880a-a92b4be3cfba', 'd84843d5-0982-42d9-af19-45e2b3bf4048', 'f08a21a6-bee9-45f3-88be-2772a7d51bbb', '0488ab3a-1451-499c-8eeb-2e2d61259446'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:03 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:03 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Deleted volume successfully. Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52f96209-727d-4ea6-aa5c-006d8bd8d931 tempest-ProjectReaderTests-868703340 None] Lock "cinder-1dcc20bf-9180-4e29-b1c8-0d54c292c547-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:03 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Deleted volume successfully. Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c011d51-d3c4-4663-b204-f2eee6c5533c tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-aea0d059-f625-49fa-9902-a15c326e34d0-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (e7ca069e-45bc-4ac8-a9b1-2e2a4f94abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077a7939-2431-4150-88b1-af58b8ddcf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077a7939-2431-4150-88b1-af58b8ddcf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186462997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43950d37-d5d3-4007-b604-e888af81dc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:04Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2421a2e3-788e-4726-ab36-f21a8915adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2421a2e3-788e-4726-ab36-f21a8915adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647b15a1-9e2f-4829-901f-c6d48222b825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647b15a1-9e2f-4829-901f-c6d48222b825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43950d37-d5d3-4007-b604-e888af81dc6e', 'volume_name': 'volume-43950d37-d5d3-4007-b604-e888af81dc6e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9008a26e-ac79-4cb0-b47a-a65dbde4ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9008a26e-ac79-4cb0-b47a-a65dbde4ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6055c36a-23ca-4113-95dc-5b6c60eabe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Volume 43950d37-d5d3-4007-b604-e888af81dc6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43950d37-d5d3-4007-b604-e888af81dc6e', 'volume_size': 1} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186462997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43950d37-d5d3-4007-b604-e888af81dc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:04Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Creating volume 43950d37-d5d3-4007-b604-e888af81dc6e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:03 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e 1073741824 Jul 21 19:20:03 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e 1073741824" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:04 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e Jul 21 19:20:04 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:04 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6055c36a-23ca-4113-95dc-5b6c60eabe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43950d37-d5d3-4007-b604-e888af81dc6e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6f11e6-3b08-493b-b70c-da8ecd7bd50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Volume volume-43950d37-d5d3-4007-b604-e888af81dc6e (43950d37-d5d3-4007-b604-e888af81dc6e): created successfully Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6f11e6-3b08-493b-b70c-da8ecd7bd50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (e7ca069e-45bc-4ac8-a9b1-2e2a4f94abfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90197819-8eb7-4217-83e5-dc8ab2f9dff1 tempest-ProjectReaderTests-868703340 None] Created volume successfully. Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (d8963923-a0ae-446a-a55f-f0845db4e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440810b1-79fd-4df2-bac8-8f607b1770de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440810b1-79fd-4df2-bac8-8f607b1770de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-251510294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58287c9f-59a9-4bda-acea-1e85cc231404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:05Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa165e-e64f-4beb-970c-8b073f7666c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfa165e-e64f-4beb-970c-8b073f7666c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e81c84-5699-4e66-bb00-a239b21965fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e81c84-5699-4e66-bb00-a239b21965fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58287c9f-59a9-4bda-acea-1e85cc231404', 'volume_name': 'volume-58287c9f-59a9-4bda-acea-1e85cc231404', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def81f81-f724-49d9-a96c-d8b19ecc2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def81f81-f724-49d9-a96c-d8b19ecc2c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1aebc0-2ac0-44c2-b68f-00dd42320c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Volume 58287c9f-59a9-4bda-acea-1e85cc231404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58287c9f-59a9-4bda-acea-1e85cc231404', 'volume_size': 1} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-251510294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58287c9f-59a9-4bda-acea-1e85cc231404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:05Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Creating volume 58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:05 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 1073741824 Jul 21 19:20:05 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-4b140112-c927-42ba-85e5-61792a76fdcf req-a6923fff-7a88-44f6-bca1-e85fbed65ee4 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:05 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 1073741824" returned: 0 in 0.514s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:05 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:05 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-43950d37-d5d3-4007-b604-e888af81dc6e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "cinder-43950d37-d5d3-4007-b604-e888af81dc6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-quobyte-43950d37-d5d3-4007-b604-e888af81dc6e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-43950d37-d5d3-4007-b604-e888af81dc6e" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7b37a7-866f-46b7-9272-a99d929cd443]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:05 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-4b140112-c927-42ba-85e5-61792a76fdcf req-a6923fff-7a88-44f6-bca1-e85fbed65ee4 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.572s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1aebc0-2ac0-44c2-b68f-00dd42320c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58287c9f-59a9-4bda-acea-1e85cc231404', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186eb77c-47b8-4c37-b2f4-c6dc95623ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-4b140112-c927-42ba-85e5-61792a76fdcf req-a6923fff-7a88-44f6-bca1-e85fbed65ee4 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Volume volume-58287c9f-59a9-4bda-acea-1e85cc231404 (58287c9f-59a9-4bda-acea-1e85cc231404): created successfully Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186eb77c-47b8-4c37-b2f4-c6dc95623ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (d8963923-a0ae-446a-a55f-f0845db4e812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fb92f506-d668-4277-93a5-971723375978 tempest-VolumesSnapshotTestJSON-980902159 None] Created volume successfully. Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-4b140112-c927-42ba-85e5-61792a76fdcf req-a6923fff-7a88-44f6-bca1-e85fbed65ee4 tempest-TestInstancesWithCinderVolumes-177576695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-36b8c335-514b-4d40-8000-2d0fb12b6ded', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3fe15be-2bfe-4188-b4c6-7ee613eef28b', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:20:06 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e Jul 21 19:20:06 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-4b140112-c927-42ba-85e5-61792a76fdcf req-a6923fff-7a88-44f6-bca1-e85fbed65ee4 tempest-TestInstancesWithCinderVolumes-177576695 None] attachment_update completed successfully. Jul 21 19:20:06 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:06 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e Jul 21 19:20:06 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:06 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-43950d37-d5d3-4007-b604-e888af81dc6e" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-43950d37-d5d3-4007-b604-e888af81dc6e" released by "delete_volume" :: held 0.922s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Created reservations ['1dbad088-eb4f-4b38-8594-8ae6b0f5c4d0', 'aed13f83-3fa4-45e5-9d22-6597ad0f6b9a', '4ee53a0c-bc0b-4fc4-943b-43d1d1ec0349', '11dc9ef8-1934-4a41-b79a-9a6d68930cd2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:07 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Creating offline snapshot 3dc511bd-3fa8-46d8-a8e5-6c5716dc325f of volume 58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883c7f5-21ad-48c2-b401-cbb258dacce9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Deleted volume successfully. Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2c44e6d-7f10-491d-94a2-3a1358733093 tempest-ProjectReaderTests-868703340 None] Lock "cinder-43950d37-d5d3-4007-b604-e888af81dc6e-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:07 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:07 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:07 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f 1G Jul 21 19:20:07 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (914f920a-b7bd-4c93-9865-a7486a8cbdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda12d5-983f-4aed-a030-157a2cd3fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda12d5-983f-4aed-a030-157a2cd3fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551915653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b948485d-0b7d-4988-9a3c-494bd97b9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:08Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75fdad1-5f76-463b-a0ba-c56bf6752586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75fdad1-5f76-463b-a0ba-c56bf6752586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9918f78-f050-44a5-ae29-a2926fcda457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9918f78-f050-44a5-ae29-a2926fcda457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b948485d-0b7d-4988-9a3c-494bd97b9ad4', 'volume_name': 'volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6c77c1-6911-47fb-99af-2fefebdddaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6c77c1-6911-47fb-99af-2fefebdddaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b491576-00c5-4273-865d-2be2cef00cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Volume b948485d-0b7d-4988-9a3c-494bd97b9ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4', 'volume_size': 1} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:08 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f 1G" returned: 0 in 0.601s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58287c9f-59a9-4bda-acea-1e85cc231404 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58287c9f-59a9-4bda-acea-1e85cc231404 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:08 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:08 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58287c9f-59a9-4bda-acea-1e85cc231404 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-88e956b8-4b32-42e0-b93f-0edca523d775 req-36bc4423-dbe7-4195-b259-8daa77836621 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f is being set with open permissions: ugo+rw Jul 21 19:20:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:08 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:08 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info Jul 21 19:20:09 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info is being set with open permissions: ugo+rw Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info Jul 21 19:20:09 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.info" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551915653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b948485d-0b7d-4988-9a3c-494bd97b9ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:08Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Creating volume b948485d-0b7d-4988-9a3c-494bd97b9ad4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:09 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 1073741824 Jul 21 19:20:09 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ef777d9-4472-4dba-a0d6-c291188c9020 tempest-VolumesSnapshotTestJSON-980902159 None] Create snapshot completed successfully Jul 21 19:20:10 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 1073741824" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:10 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 Jul 21 19:20:10 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:10 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-88e956b8-4b32-42e0-b93f-0edca523d775 req-36bc4423-dbe7-4195-b259-8daa77836621 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.679s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b491576-00c5-4273-865d-2be2cef00cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be04679-b23d-42bc-815f-3af9a2a40ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-88e956b8-4b32-42e0-b93f-0edca523d775 req-36bc4423-dbe7-4195-b259-8daa77836621 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Volume volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 (b948485d-0b7d-4988-9a3c-494bd97b9ad4): created successfully Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be04679-b23d-42bc-815f-3af9a2a40ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (914f920a-b7bd-4c93-9865-a7486a8cbdf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-40fa6795-f44d-487d-869a-28ee2df333d8 tempest-ProjectReaderTests-868703340 None] Created volume successfully. Jul 21 19:20:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-88e956b8-4b32-42e0-b93f-0edca523d775 req-36bc4423-dbe7-4195-b259-8daa77836621 tempest-TestInstancesWithCinderVolumes-177576695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3a136c8-741c-48e4-b628-8d16bc84ac65', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:20:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-88e956b8-4b32-42e0-b93f-0edca523d775 req-36bc4423-dbe7-4195-b259-8daa77836621 tempest-TestInstancesWithCinderVolumes-177576695 None] attachment_update completed successfully. Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (97855c20-4c0d-41a4-a9d2-f85146bc104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b898d-6591-4d81-a249-53ffeb9320fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-b948485d-0b7d-4988-9a3c-494bd97b9ad4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468b898d-6591-4d81-a249-53ffeb9320fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1654940988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1c49ed-28df-4a04-93b6-d3dd5a72e501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd512ce243984684b4a2f76e1a393f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3dc511bd-3fa8-46d8-a8e5-6c5716dc325f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:11Z,use_quota=True,user_id='cd438fe5aef74b4e9968cd1e857320e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51c0b8b-21c9-41ca-ac5b-5decbc89d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51c0b8b-21c9-41ca-ac5b-5decbc89d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f66539-40d5-4ea3-bf62-6e50d5a8849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f66539-40d5-4ea3-bf62-6e50d5a8849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e1c49ed-28df-4a04-93b6-d3dd5a72e501', 'volume_name': 'volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501', 'volume_size': 1, 'snapshot_id': '3dc511bd-3fa8-46d8-a8e5-6c5716dc325f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe38fce-2698-4024-8278-b0cd7a53ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe38fce-2698-4024-8278-b0cd7a53ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2098e5-d7d6-4d75-a06b-b6d9fd8cc920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Volume 9e1c49ed-28df-4a04-93b6-d3dd5a72e501: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501', 'volume_size': 1, 'snapshot_id': '3dc511bd-3fa8-46d8-a8e5-6c5716dc325f'} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "cinder-b948485d-0b7d-4988-9a3c-494bd97b9ad4-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Creating volume 9e1c49ed-28df-4a04-93b6-d3dd5a72e501 from snapshot 3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-quobyte-b948485d-0b7d-4988-9a3c-494bd97b9ad4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] snapshot: 3dc511bd-3fa8-46d8-a8e5-6c5716dc325f, volume: 9e1c49ed-28df-4a04-93b6-d3dd5a72e501, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-b948485d-0b7d-4988-9a3c-494bd97b9ad4" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d20a64-c916-40d0-9203-4e7c76efa187]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4dd6cb-4eae-4cfc-873b-29525d110089]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 Jul 21 19:20:11 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:11 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58287c9f-59a9-4bda-acea-1e85cc231404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed0d6f6-075c-432b-8dba-fc18e0d33b11]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:11 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4 Jul 21 19:20:11 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:11 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:11 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b948485d-0b7d-4988-9a3c-494bd97b9ad4" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-b948485d-0b7d-4988-9a3c-494bd97b9ad4" released by "delete_volume" :: held 0.816s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Created reservations ['2221d7a0-1b2d-47aa-a2b8-9bc5b7957f00', '1e10611d-907c-40d4-8710-3e93b7b67cd2', '97234569-1b45-46c4-b2d0-39fa6acf85fa', '4f1c64c3-b5fe-4a77-931b-9b52dbd22669'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:12 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 Jul 21 19:20:12 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:12 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:12 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:12 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Deleted volume successfully. Jul 21 19:20:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-44f0fcb1-6f6d-4e00-b813-357a35172f01 tempest-ProjectReaderTests-868703340 None] Lock "cinder-b948485d-0b7d-4988-9a3c-494bd97b9ad4-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (f941e2d1-3a0f-4e0d-aa47-31b3b73826ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137e146-dac6-4a07-b1a4-b9a1b17577d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0137e146-dac6-4a07-b1a4-b9a1b17577d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892002129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5435210e-99c2-4071-96d8-0f86047dbaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:13Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d56712-9d51-48a1-badc-e985339f7c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d56712-9d51-48a1-badc-e985339f7c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681b79e8-2c2d-4d05-b6d4-ccda23414e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681b79e8-2c2d-4d05-b6d4-ccda23414e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5435210e-99c2-4071-96d8-0f86047dbaee', 'volume_name': 'volume-5435210e-99c2-4071-96d8-0f86047dbaee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fab716a-6792-41d6-b994-e2f51c33e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fab716a-6792-41d6-b994-e2f51c33e735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1fc973-21c3-4825-a266-c3aab46012e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Volume 5435210e-99c2-4071-96d8-0f86047dbaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5435210e-99c2-4071-96d8-0f86047dbaee', 'volume_size': 1} Jul 21 19:20:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:17 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" returned: 0 in 5.577s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf277e7-5eaa-4fb0-8441-c2de7a4d5584]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b85d1210-a355-420e-9ab1-87582392061b req-e40def13-ba36-4e64-8995-5a577059e20c tempest-TestInstancesWithCinderVolumes-177576695 None] Terminate volume connection completed successfully. Jul 21 19:20:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b85d1210-a355-420e-9ab1-87582392061b req-e40def13-ba36-4e64-8995-5a577059e20c tempest-TestInstancesWithCinderVolumes-177576695 None] Deleting attachment f3fe15be-2bfe-4188-b4c6-7ee613eef28b. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:20:18 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:18 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Flow 'volume_create_manager' (6dd1e432-e180-4b82-b61a-9d7b8361521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f129a359-98f9-4342-a5dc-adc4a2489279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f129a359-98f9-4342-a5dc-adc4a2489279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5755c3ae-55e4-49a8-8208-a6b882632262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b5302cb6f24b95887e440295514f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:18Z,use_quota=True,user_id='cbbaf9a37a1642c4a39ca6542ac9e292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69994d6c-cacd-4236-bd7b-a3c1dfe80bc1),volume_type_id=69994d6c-cacd-4236-bd7b-a3c1dfe80bc1)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18627fe0-eb6e-42dd-9027-0f3543d99d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18627fe0-eb6e-42dd-9027-0f3543d99d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42fb48a-d198-46da-ac0c-1ad2d002d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42fb48a-d198-46da-ac0c-1ad2d002d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5755c3ae-55e4-49a8-8208-a6b882632262', 'volume_name': 'volume-5755c3ae-55e4-49a8-8208-a6b882632262', 'volume_size': 1, 'image_id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03ed448a3f685784f51265977f436ffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35b5302cb6f24b95887e440295514f00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4134319dcdccd9c3434596b48dbd4c4a98806ab05ebda2e16ba2fa264ee8762e6d98f71fb1e36514670a1df621f9ca4c7e4cde3868e9750a660ab9830456a74c', 'id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'created_at': datetime.datetime(2026, 7, 21, 17, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 20, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b911c85f-8a59-480c-9314-a006789edb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b911c85f-8a59-480c-9314-a006789edb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e50bd-9c8a-4ea1-9ae7-c3e7006a1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Volume 5755c3ae-55e4-49a8-8208-a6b882632262: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5755c3ae-55e4-49a8-8208-a6b882632262', 'volume_size': 1, 'image_id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03ed448a3f685784f51265977f436ffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35b5302cb6f24b95887e440295514f00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4134319dcdccd9c3434596b48dbd4c4a98806ab05ebda2e16ba2fa264ee8762e6d98f71fb1e36514670a1df621f9ca4c7e4cde3868e9750a660ab9830456a74c', 'id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'created_at': datetime.datetime(2026, 7, 21, 17, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 20, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Trying to clone 5755c3ae-55e4-49a8-8208-a6b882632262 from image e006dcf8-e4a4-4cf7-9327-fce66392be3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:20:18 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.607s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:20:18 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Converted 1024.00 MB image at 183.57 MB/s Jul 21 19:20:18 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 is being set with open permissions: ugo+rw Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 Jul 21 19:20:18 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:20:18 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-36b8c335-514b-4d40-8000-2d0fb12b6ded-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c71bc-c689-43b1-b9d2-cf35d5ccd2eb]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-36b8c335-514b-4d40-8000-2d0fb12b6ded-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-quobyte-36b8c335-514b-4d40-8000-2d0fb12b6ded" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-36b8c335-514b-4d40-8000-2d0fb12b6ded" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24eb596-e2b3-4c2a-b998-01d583ee107d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:18 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" released by "_copy_volume_from_snapshot" :: held 7.496s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" released by "_create_volume_from_snapshot" :: held 7.552s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.582s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.704s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892002129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5435210e-99c2-4071-96d8-0f86047dbaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02745908c65e40eea747f6c718a71fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:13Z,use_quota=True,user_id='d7521571b5484cf4a0a80879c9d66e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Creating volume 5435210e-99c2-4071-96d8-0f86047dbaee {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:18 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee 1073741824 Jul 21 19:20:18 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2098e5-d7d6-4d75-a06b-b6d9fd8cc920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501', 'volume_size': 1, 'snapshot_id': '3dc511bd-3fa8-46d8-a8e5-6c5716dc325f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b22d7d-463c-4149-993a-ac7d94e4d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:18 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded Jul 21 19:20:18 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Volume volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 (9e1c49ed-28df-4a04-93b6-d3dd5a72e501): created successfully Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b22d7d-463c-4149-993a-ac7d94e4d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Flow 'volume_create_manager' (97855c20-4c0d-41a4-a9d2-f85146bc104a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48f86a8c-49d5-4e2b-9deb-ab095085e512 tempest-VolumesSnapshotTestJSON-980902159 None] Created volume successfully. Jul 21 19:20:19 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:19 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded Jul 21 19:20:19 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee 1073741824" returned: 0 in 0.612s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee Jul 21 19:20:19 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Temporary image e006dcf8-e4a4-4cf7-9327-fce66392be3c is fetched for user cbbaf9a37a1642c4a39ca6542ac9e292. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:20:19 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-36b8c335-514b-4d40-8000-2d0fb12b6ded" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-36b8c335-514b-4d40-8000-2d0fb12b6ded" released by "delete_volume" :: held 0.875s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:19 devstack cinder-volume[87498]: WARNING cinder.quota [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1114425833-765834102 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1114425833-765834102, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:19 devstack cinder-volume[87498]: WARNING cinder.quota [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1114425833-765834102 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1114425833-765834102, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4e3312-e28a-44a2-92a4-a3d0448ff5e5]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Created reservations ['c3e7bc72-9e37-49de-a114-fea1c63954f1', '62077aa1-d0c2-4cea-a728-3e04ea41c23b', '8bafc652-783a-4036-8359-92639e88db1e', '173ee046-5843-45b1-bfea-db77c2eaf491'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:19 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:19 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:19 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:19 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1fc973-21c3-4825-a266-c3aab46012e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5435210e-99c2-4071-96d8-0f86047dbaee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4765419-4af5-43cd-acbc-8b6c7cab2e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Volume volume-5435210e-99c2-4071-96d8-0f86047dbaee (5435210e-99c2-4071-96d8-0f86047dbaee): created successfully Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4765419-4af5-43cd-acbc-8b6c7cab2e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Flow 'volume_create_manager' (f941e2d1-3a0f-4e0d-aa47-31b3b73826ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cb8d7117-42de-4e8b-a2ee-1b5e3e32d4ec tempest-ProjectReaderTests-868703340 None] Created volume successfully. Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-9e1c49ed-28df-4a04-93b6-d3dd5a72e501-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9e1c49ed-28df-4a04-93b6-d3dd5a72e501-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Deleted volume successfully. Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25965204-38c2-40aa-a51c-7374778dce59 tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-36b8c335-514b-4d40-8000-2d0fb12b6ded-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2a69d-abab-48ef-aed8-8f76ef394aaf]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:20 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 Jul 21 19:20:20 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5755c3ae-55e4-49a8-8208-a6b882632262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b5302cb6f24b95887e440295514f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:18Z,use_quota=True,user_id='cbbaf9a37a1642c4a39ca6542ac9e292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69994d6c-cacd-4236-bd7b-a3c1dfe80bc1),volume_type_id=69994d6c-cacd-4236-bd7b-a3c1dfe80bc1)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Creating volume 5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1073741824 Jul 21 19:20:20 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:20 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501 Jul 21 19:20:20 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-5435210e-99c2-4071-96d8-0f86047dbaee-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "cinder-5435210e-99c2-4071-96d8-0f86047dbaee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Acquiring lock "cinder-quobyte-5435210e-99c2-4071-96d8-0f86047dbaee" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-5435210e-99c2-4071-96d8-0f86047dbaee" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac26db-1b02-424d-88e4-3b7179aa5e7e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-9e1c49ed-28df-4a04-93b6-d3dd5a72e501" released by "delete_volume" :: held 0.847s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['d02d9cc3-b99a-4bfb-a073-46c407fafc00', 'd773dfac-a464-4808-88f1-da5fef8d8418', '8c7f0d68-4d3e-4655-9916-3d20a8765c9e', '88286d4b-25f6-4b70-bb60-233ba2409a63'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:21 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee Jul 21 19:20:21 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1073741824" returned: 0 in 0.587s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 Jul 21 19:20:21 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:21 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:21 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Deleting offline snapshot 3dc511bd-3fa8-46d8-a8e5-6c5716dc325f of volume 58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:20:21 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] snapshot_file for this snap is: volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee" returned: 0 in 0.599s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af20dde-4300-4842-8dcf-eda9a5a03744]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee Jul 21 19:20:21 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Deleted volume successfully. Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Attempting download of e006dcf8-e4a4-4cf7-9327-fce66392be3c ((None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}])) to volume 5755c3ae-55e4-49a8-8208-a6b882632262. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d988d5b-4979-4888-a358-8d63238b4f95 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-9e1c49ed-28df-4a04-93b6-d3dd5a72e501-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:21 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f91526-304e-4367-87ad-74d4d10e8791]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:21 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5435210e-99c2-4071-96d8-0f86047dbaee" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "cinder-quobyte-5435210e-99c2-4071-96d8-0f86047dbaee" released by "delete_volume" :: held 0.981s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:21 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm Jul 21 19:20:21 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Created reservations ['317263be-4fdc-4685-9618-308de63931bd', '4d9cb0ca-d9eb-419b-97ae-f0ba56bb9da3', '3643ecf0-1db6-4bb2-b9dc-85d85771bc97', '73a457eb-79c3-4940-9875-b61807ed683d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:22 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58287c9f-59a9-4bda-acea-1e85cc231404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797f1f9-6ffb-45da-a7c5-3abe4c7af484]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:22 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:22 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm Jul 21 19:20:22 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Deleted volume successfully. Jul 21 19:20:22 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:22 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm" returned: 1 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e006dcf8-e4a4-4cf7-9327-fce66392be3c_ejk0p2fm' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce0a572-eb49-4859-965c-b1d01a62678e]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-29a2581d-5177-48a7-9cef-40c0c2918bc3 tempest-ProjectReaderTests-868703340 None] Lock "cinder-5435210e-99c2-4071-96d8-0f86047dbaee-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-f824463a-0a80-42b5-930a-0aa3099d0e07 req-101240e1-7880-473c-b474-a784ffe6b320 tempest-TestInstancesWithCinderVolumes-177576695 None] Terminate volume connection completed successfully. Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-f824463a-0a80-42b5-930a-0aa3099d0e07 req-101240e1-7880-473c-b474-a784ffe6b320 tempest-TestInstancesWithCinderVolumes-177576695 None] Deleting attachment c3a136c8-741c-48e4-b628-8d16bc84ac65. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:20:22 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:22 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:22 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f Jul 21 19:20:23 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD Jul 21 19:20:23 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404.3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f" released by "_delete_snapshot" :: held 1.716s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" released by "delete_snapshot" :: held 1.749s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:23 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] e006dcf8-e4a4-4cf7-9327-fce66392be3c was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 Jul 21 19:20:23 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['1b53ed42-b974-4077-b205-9830befd6dd2', 'c10b4ee7-e56e-4095-9c70-c41893b82287', '07c6729d-03a7-407a-b5a3-4fda545128f1', '0580be58-65f6-476e-921e-755b4d58d776'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Delete snapshot completed successfully. Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69a36972-6e6f-401a-962c-7ab045cc58b1 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-3dc511bd-3fa8-46d8-a8e5-6c5716dc325f-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-quobyte-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f773dce-ecb2-4543-a449-e5028034e19e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-58287c9f-59a9-4bda-acea-1e85cc231404-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-58287c9f-59a9-4bda-acea-1e85cc231404-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:23 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 Jul 21 19:20:23 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[083f97ec-2766-48ac-95e6-6382e3fdb252]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262" returned: 0 in 0.695s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e006dcf8-e4a4-4cf7-9327-fce66392be3c_wxamq9bsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:20:24 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1G Jul 21 19:20:24 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:24 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" returned: 0 in 0.585s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93 Jul 21 19:20:24 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:24 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404 Jul 21 19:20:24 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 1G" returned: 0 in 0.578s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Downloaded image e006dcf8-e4a4-4cf7-9327-fce66392be3c ((None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}])) to volume 5755c3ae-55e4-49a8-8208-a6b882632262 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Temporary image e006dcf8-e4a4-4cf7-9327-fce66392be3c for user cbbaf9a37a1642c4a39ca6542ac9e292 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Marking volume 5755c3ae-55e4-49a8-8208-a6b882632262 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Copying metadata from image e006dcf8-e4a4-4cf7-9327-fce66392be3c to 5755c3ae-55e4-49a8-8208-a6b882632262. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Creating volume glance metadata for volume 5755c3ae-55e4-49a8-8208-a6b882632262 backed by image e006dcf8-e4a4-4cf7-9327-fce66392be3c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '03ed448a3f685784f51265977f436ffe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e50bd-9c8a-4ea1-9ae7-c3e7006a1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5755c3ae-55e4-49a8-8208-a6b882632262', 'volume_size': 1, 'image_id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '03ed448a3f685784f51265977f436ffe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35b5302cb6f24b95887e440295514f00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4134319dcdccd9c3434596b48dbd4c4a98806ab05ebda2e16ba2fa264ee8762e6d98f71fb1e36514670a1df621f9ca4c7e4cde3868e9750a660ab9830456a74c', 'id': 'e006dcf8-e4a4-4cf7-9327-fce66392be3c', 'created_at': datetime.datetime(2026, 7, 21, 17, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 20, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e006dcf8-e4a4-4cf7-9327-fce66392be3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2173dbc2-67f6-40ae-8cc0-018d664e4687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:24 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Volume volume-5755c3ae-55e4-49a8-8208-a6b882632262 (5755c3ae-55e4-49a8-8208-a6b882632262): created successfully Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2173dbc2-67f6-40ae-8cc0-018d664e4687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Flow 'volume_create_manager' (6dd1e432-e180-4b82-b61a-9d7b8361521a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93" released by "delete_volume" :: held 1.141s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f7ffb32-92c8-4449-99fc-2b69f32f6eac tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Created volume successfully. Jul 21 19:20:24 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:24 devstack cinder-volume[87498]: WARNING cinder.quota [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1465166526-120393783 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1465166526-120393783, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:24 devstack cinder-volume[87498]: WARNING cinder.quota [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1465166526-120393783 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1465166526-120393783, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-58287c9f-59a9-4bda-acea-1e85cc231404" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-58287c9f-59a9-4bda-acea-1e85cc231404" released by "delete_volume" :: held 0.980s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Created reservations ['b6a38b25-546b-443b-93ef-588821bc09ea', 'cfd72a9d-8704-4eab-839d-fdb1eb6cc367', 'f3591688-14af-4a05-9bdc-3ba5b24aa81d', 'a809d6a9-9dfe-4152-b4b9-4c1919a6a39b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['1709daf6-0665-4d57-9427-66c826cbeb06', '3bfa2877-7478-4b48-9562-0f3347e0cd6b', '948b8119-4fa5-49e2-b34c-6834d061aa6f', '0d6038d8-d216-40c2-9118-1d0e9c09aac0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:25 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:25 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:25 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Deleted volume successfully. Jul 21 19:20:25 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Deleted volume successfully. Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3390b9a7-3295-44ad-9706-748ab3ea6fee tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-5060c0d5-9ac1-45b8-b12c-ca0b73ff2a93-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f49dbb8c-31ca-42d8-948f-7257a660d9e8 tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-58287c9f-59a9-4bda-acea-1e85cc231404-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:25 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:25 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Acquiring lock "cinder-5755c3ae-55e4-49a8-8208-a6b882632262-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "cinder-5755c3ae-55e4-49a8-8208-a6b882632262-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Acquiring lock "cinder-quobyte-5755c3ae-55e4-49a8-8208-a6b882632262" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "cinder-quobyte-5755c3ae-55e4-49a8-8208-a6b882632262" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.553s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69198919-2805-4c3e-8914-25c9d24c3c73]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-97dc16ab-a68c-44de-b358-60a97bce92f2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-97dc16ab-a68c-44de-b358-60a97bce92f2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:26 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 Jul 21 19:20:26 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf47cc5-e802-401e-9d0c-4e2b08118b1d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 Jul 21 19:20:26 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:26 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:26 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262 Jul 21 19:20:26 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2 Jul 21 19:20:27 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5755c3ae-55e4-49a8-8208-a6b882632262" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "cinder-quobyte-5755c3ae-55e4-49a8-8208-a6b882632262" released by "delete_volume" :: held 0.892s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:27 devstack cinder-volume[87498]: WARNING cinder.quota [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:27 devstack cinder-volume[87498]: WARNING cinder.quota [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Created reservations ['73cac287-065d-4714-a5ba-126f5433a26c', 'c350eac0-3e10-476f-b46f-f3dd0b021dcd', '180e4b6b-99af-4f48-9df4-ede25c79c934', '185545d6-fe89-4e30-b759-ca16d0be5759'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-97dc16ab-a68c-44de-b358-60a97bce92f2" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:27 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-quobyte-97dc16ab-a68c-44de-b358-60a97bce92f2" released by "delete_volume" :: held 0.948s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Created reservations ['63d9188e-9163-4b4b-b188-aa5a96895e1f', '9eac09a9-1b21-427e-9c2c-fef8ed0aa92a', 'e85e3ccb-88f2-44cd-9cea-275b3c335e33', 'e0bf24f5-e315-4519-89f5-13b77195ccae'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:27 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:27 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:27 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Deleted volume successfully. Jul 21 19:20:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-40351cef-6516-4aac-ac88-89a6b3e6eb82 tempest-VolumeAndVolumeTypeFromImageTest-1339966803 None] Lock "cinder-5755c3ae-55e4-49a8-8208-a6b882632262-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:28 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Deleted volume successfully. Jul 21 19:20:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4708bfb-add9-4bcd-9efd-327d7af88c9d tempest-VolumesSnapshotTestJSON-980902159 None] Lock "cinder-97dc16ab-a68c-44de-b358-60a97bce92f2-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-270bddcf-207d-4f58-b500-4f5b26223df1 req-1052e994-43f8-41fe-8f0b-9e514b25d52c tempest-TestInstancesWithCinderVolumes-177576695 None] Terminate volume connection completed successfully. Jul 21 19:20:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-270bddcf-207d-4f58-b500-4f5b26223df1 req-1052e994-43f8-41fe-8f0b-9e514b25d52c tempest-TestInstancesWithCinderVolumes-177576695 None] Deleting attachment bdd27430-7c73-4eb9-8e9d-01f8b4c76480. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:20:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-dd92f9e4-b66a-40d2-888f-cbf2cc414558-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-dd92f9e4-b66a-40d2-888f-cbf2cc414558-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "cinder-quobyte-dd92f9e4-b66a-40d2-888f-cbf2cc414558" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-dd92f9e4-b66a-40d2-888f-cbf2cc414558" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c94ecba-3d19-4927-9755-03bd2f52df86]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:30 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 Jul 21 19:20:30 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:30 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558 Jul 21 19:20:30 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:30 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dd92f9e4-b66a-40d2-888f-cbf2cc414558" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-quobyte-dd92f9e4-b66a-40d2-888f-cbf2cc414558" released by "delete_volume" :: held 0.753s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=175,cinder:UPDATE=201,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:20:30 devstack cinder-volume[87498]: WARNING cinder.quota [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-827441858-1602898450 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-827441858-1602898450, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:30 devstack cinder-volume[87498]: WARNING cinder.quota [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-827441858-1602898450 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-827441858-1602898450, it is now deprecated. Please use the default quota class for default quota. Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Created reservations ['4cb543a2-f3d6-4b14-b776-c78b46ca3635', '7790da69-3840-4e02-a936-271085d5ee22', '1b060976-933d-4426-8d39-8d67fee6fb2f', '27ddb410-853b-4572-ac55-8d5d02511943'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:31 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:31 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:31 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Deleted volume successfully. Jul 21 19:20:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0640e11b-d0b5-4dda-b0f8-7cec9ade56fc tempest-TestInstancesWithCinderVolumes-177576695 None] Lock "cinder-dd92f9e4-b66a-40d2-888f-cbf2cc414558-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (b5d1910a-b2af-418a-b74f-d9808f396a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5641e9ff-d702-4a13-82ae-af1b550c40b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=173,cinder:UPDATE=221,cinder:DELETE=19,cinder:INSERT=59 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5641e9ff-d702-4a13-82ae-af1b550c40b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330316090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c71022-47e0-4df8-bfdb-b5e1e4b19be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:34Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c134456a-aabe-4f95-8c59-52f1c3b2e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c134456a-aabe-4f95-8c59-52f1c3b2e198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730ff98-0419-4ce2-84b6-894d2123eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8730ff98-0419-4ce2-84b6-894d2123eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c71022-47e0-4df8-bfdb-b5e1e4b19be1', 'volume_name': 'volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c44ee88-8ef8-4258-a87a-c587ba84c40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c44ee88-8ef8-4258-a87a-c587ba84c40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ff1874-6f50-41a6-a69a-9aefff4184da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume 15c71022-47e0-4df8-bfdb-b5e1e4b19be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1', 'volume_size': 1} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330316090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c71022-47e0-4df8-bfdb-b5e1e4b19be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:34Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume 15c71022-47e0-4df8-bfdb-b5e1e4b19be1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:33 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 1073741824 Jul 21 19:20:33 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 1073741824" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:34 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 Jul 21 19:20:34 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:34 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ff1874-6f50-41a6-a69a-9aefff4184da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b646ad4-6614-4f91-a089-cc18599c41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 (15c71022-47e0-4df8-bfdb-b5e1e4b19be1): created successfully Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b646ad4-6614-4f91-a089-cc18599c41ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (b5d1910a-b2af-418a-b74f-d9808f396a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e243b27b-2151-455b-ace9-2b21d5a4fb2f tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (c55bc4f5-5998-4a8d-82c0-5762b14059dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3c5bba-58e0-4a87-bf1a-ec3feba3931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3c5bba-58e0-4a87-bf1a-ec3feba3931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656724574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9b87e9-df1a-4bc9-97aa-12a246f88cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:36Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956bf7ce-17ac-4f2a-954e-ed40cdc56fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956bf7ce-17ac-4f2a-954e-ed40cdc56fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4750e9d-b36e-4c8a-9112-4b7c9ea495e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4750e9d-b36e-4c8a-9112-4b7c9ea495e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9b87e9-df1a-4bc9-97aa-12a246f88cad', 'volume_name': 'volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d82fe81-dc9c-4cc5-ab6d-75f5f1fff0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d82fe81-dc9c-4cc5-ab6d-75f5f1fff0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2dab7e-a547-4d61-9053-70c53c69927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume 5b9b87e9-df1a-4bc9-97aa-12a246f88cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad', 'volume_size': 1} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656724574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9b87e9-df1a-4bc9-97aa-12a246f88cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:36Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume 5b9b87e9-df1a-4bc9-97aa-12a246f88cad {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:36 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad 1073741824 Jul 21 19:20:36 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (779d834a-7eab-455d-a1d6-c8a16bc8f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672a0680-0e7e-413c-b11f-7cfd2136c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672a0680-0e7e-413c-b11f-7cfd2136c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119007631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a1f60a-4e88-4898-85f6-055eb73a959f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:37Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80fdb63-4f65-4d7e-8a25-7f3c14787b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80fdb63-4f65-4d7e-8a25-7f3c14787b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa678a7-2a7a-405a-835f-8b10b7dee0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa678a7-2a7a-405a-835f-8b10b7dee0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a1f60a-4e88-4898-85f6-055eb73a959f', 'volume_name': 'volume-f5a1f60a-4e88-4898-85f6-055eb73a959f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d6510a-4048-40c2-a788-300699bbc515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d6510a-4048-40c2-a788-300699bbc515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6e4fb-045f-4728-9e6d-cf4cb47f88a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume f5a1f60a-4e88-4898-85f6-055eb73a959f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a1f60a-4e88-4898-85f6-055eb73a959f', 'volume_size': 1} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:37 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad 1073741824" returned: 0 in 0.777s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:37 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad Jul 21 19:20:37 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (f6786a19-684e-4895-b999-6fcfaed7a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44201a40-c893-414b-946e-20fdb3e2cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44201a40-c893-414b-946e-20fdb3e2cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113111522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ab593e-a4e8-423c-8ca2-f552594242f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:38Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963d895f-054b-4b19-b5b2-9ced310e2e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963d895f-054b-4b19-b5b2-9ced310e2e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c1908f-45a2-477b-b074-f47f426ae6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c1908f-45a2-477b-b074-f47f426ae6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ab593e-a4e8-423c-8ca2-f552594242f8', 'volume_name': 'volume-69ab593e-a4e8-423c-8ca2-f552594242f8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9facaaa2-5265-4621-b32f-e9ee76ea42b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9facaaa2-5265-4621-b32f-e9ee76ea42b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f497f-7204-4cdd-994b-a1fb2d5c592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume 69ab593e-a4e8-423c-8ca2-f552594242f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ab593e-a4e8-423c-8ca2-f552594242f8', 'volume_size': 1} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:37 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119007631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a1f60a-4e88-4898-85f6-055eb73a959f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:37Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume f5a1f60a-4e88-4898-85f6-055eb73a959f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2dab7e-a547-4d61-9053-70c53c69927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f 1073741824 Jul 21 19:20:38 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e151db63-4764-4547-b698-0c1d2e5c98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad (5b9b87e9-df1a-4bc9-97aa-12a246f88cad): created successfully Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e151db63-4764-4547-b698-0c1d2e5c98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (c55bc4f5-5998-4a8d-82c0-5762b14059dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5046c28a-a042-41f2-8168-8209c8c1611d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (356fc9c4-593c-4063-9e26-8a125e0d6b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52a9c3b-d785-4582-a91c-720fe54d3b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52a9c3b-d785-4582-a91c-720fe54d3b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974422868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa48d41e-befe-4a15-a751-0532c0a027fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:38Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018d717-f586-4ea9-9252-177f27388a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018d717-f586-4ea9-9252-177f27388a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ffb95-4bcc-4068-9fb9-b8834c611d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ffb95-4bcc-4068-9fb9-b8834c611d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa48d41e-befe-4a15-a751-0532c0a027fb', 'volume_name': 'volume-aa48d41e-befe-4a15-a751-0532c0a027fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cce60c-1811-4282-b2f8-c899ebb33f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cce60c-1811-4282-b2f8-c899ebb33f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c89b0-cc3d-4e46-97ed-103d17023c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume aa48d41e-befe-4a15-a751-0532c0a027fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa48d41e-befe-4a15-a751-0532c0a027fb', 'volume_size': 1} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:38 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f 1073741824" returned: 0 in 0.710s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:38 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f Jul 21 19:20:38 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (99932843-890f-47b9-a20b-a45201cbb0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6840dfe0-7542-42c4-837c-2e079c490e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6840dfe0-7542-42c4-837c-2e079c490e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656308272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce632f5-ed4b-49f5-a13b-d0002fc29dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:39Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1196059d-8135-4bae-a7aa-cd36cb4c93f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1196059d-8135-4bae-a7aa-cd36cb4c93f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ef3a67-5c13-4601-b4db-e021ffc26268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ef3a67-5c13-4601-b4db-e021ffc26268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce632f5-ed4b-49f5-a13b-d0002fc29dd4', 'volume_name': 'volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09ddb4-110f-4d25-bf96-4a71987075fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09ddb4-110f-4d25-bf96-4a71987075fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbd4179-c647-4f3f-8f5d-be666730bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume dce632f5-ed4b-49f5-a13b-d0002fc29dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4', 'volume_size': 1} Jul 21 19:20:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:39 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2113111522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ab593e-a4e8-423c-8ca2-f552594242f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:38Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume 69ab593e-a4e8-423c-8ca2-f552594242f8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6e4fb-045f-4728-9e6d-cf4cb47f88a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a1f60a-4e88-4898-85f6-055eb73a959f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc689e2-1fe4-4f3f-a266-b6609501ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:39 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 1073741824 Jul 21 19:20:39 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-f5a1f60a-4e88-4898-85f6-055eb73a959f (f5a1f60a-4e88-4898-85f6-055eb73a959f): created successfully Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc689e2-1fe4-4f3f-a266-b6609501ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (779d834a-7eab-455d-a1d6-c8a16bc8f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0030b66b-c603-45e8-a9e2-e7486c875ec3 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:39 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 1073741824" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:39 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 Jul 21 19:20:39 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:39 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974422868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa48d41e-befe-4a15-a751-0532c0a027fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:38Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume aa48d41e-befe-4a15-a751-0532c0a027fb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:40 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:40 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb 1073741824 Jul 21 19:20:40 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6f497f-7204-4cdd-994b-a1fb2d5c592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ab593e-a4e8-423c-8ca2-f552594242f8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e15fa-1c8c-4dfc-99c6-278a46c485fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-69ab593e-a4e8-423c-8ca2-f552594242f8 (69ab593e-a4e8-423c-8ca2-f552594242f8): created successfully Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e15fa-1c8c-4dfc-99c6-278a46c485fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (f6786a19-684e-4895-b999-6fcfaed7a732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-baecc119-24eb-44c3-9425-aae917cb601b tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:40 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb 1073741824" returned: 0 in 0.652s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:40 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb Jul 21 19:20:40 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:41 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.152s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656308272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce632f5-ed4b-49f5-a13b-d0002fc29dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65a2504658794dada506d865205aab10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:20:39Z,use_quota=True,user_id='3d273c709d6040bf95ef2654a90eec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Creating volume dce632f5-ed4b-49f5-a13b-d0002fc29dd4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:20:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7c89b0-cc3d-4e46-97ed-103d17023c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa48d41e-befe-4a15-a751-0532c0a027fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2731c30-f652-4b40-8ee4-b78b344cbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:41 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 1073741824 Jul 21 19:20:41 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-aa48d41e-befe-4a15-a751-0532c0a027fb (aa48d41e-befe-4a15-a751-0532c0a027fb): created successfully Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2731c30-f652-4b40-8ee4-b78b344cbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (356fc9c4-593c-4063-9e26-8a125e0d6b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2cb6846d-99d1-4d69-b9d3-318bb20fac2c tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:41 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 1073741824" returned: 0 in 0.568s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:41 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 Jul 21 19:20:41 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:41 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbd4179-c647-4f3f-8f5d-be666730bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d965596-e2a0-414c-b7a1-0dcdd64f73bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:20:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Volume volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 (dce632f5-ed4b-49f5-a13b-d0002fc29dd4): created successfully Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d965596-e2a0-414c-b7a1-0dcdd64f73bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Flow 'volume_create_manager' (99932843-890f-47b9-a20b-a45201cbb0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:20:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-caf7275c-d61c-4a9d-a635-b125ae772a0d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created volume successfully. Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-dce632f5-ed4b-49f5-a13b-d0002fc29dd4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-dce632f5-ed4b-49f5-a13b-d0002fc29dd4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f28370-7a3f-4a31-9769-2162c9f93fcd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:42 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 Jul 21 19:20:42 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:43 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:43 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4 Jul 21 19:20:43 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:43 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-dce632f5-ed4b-49f5-a13b-d0002fc29dd4" released by "delete_volume" :: held 0.837s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['f86db120-afa4-40d3-b25e-cf6af4b62843', '535b49b0-2ae4-473a-a7b9-378bf778d87b', 'cd57483f-e192-4031-81ca-3d42142b44cf', '0957768b-b74e-4c33-9f86-873b29861915'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:43 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:43 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-aa48d41e-befe-4a15-a751-0532c0a027fb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-aa48d41e-befe-4a15-a751-0532c0a027fb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-aa48d41e-befe-4a15-a751-0532c0a027fb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-aa48d41e-befe-4a15-a751-0532c0a027fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5091897-89f1-4709-9df6-0b58ac2ecf36]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:43 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbcdb37d-0386-493d-8b39-6535e91d27ba tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-dce632f5-ed4b-49f5-a13b-d0002fc29dd4-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:43 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb Jul 21 19:20:43 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:44 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:44 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb Jul 21 19:20:44 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:44 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aa48d41e-befe-4a15-a751-0532c0a027fb" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-aa48d41e-befe-4a15-a751-0532c0a027fb" released by "delete_volume" :: held 0.886s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['f49bced2-a96d-4b6e-8fa1-59236f7bb499', 'd4acd8a8-24b7-4991-866e-5779a0fd3f7c', 'b7b2c911-aae1-4b45-8279-782390572691', 'c073327a-38a6-4c36-a93b-edbb2c60f828'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:44 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:44 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:45 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09137b2a-ba5a-4af3-976a-c21abb1a939d tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-aa48d41e-befe-4a15-a751-0532c0a027fb-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-69ab593e-a4e8-423c-8ca2-f552594242f8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-69ab593e-a4e8-423c-8ca2-f552594242f8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-69ab593e-a4e8-423c-8ca2-f552594242f8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-69ab593e-a4e8-423c-8ca2-f552594242f8" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[13904481-3e2d-4277-bec0-e45a93139070]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:46 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 Jul 21 19:20:46 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:46 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:46 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8 Jul 21 19:20:46 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:46 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-69ab593e-a4e8-423c-8ca2-f552594242f8" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-69ab593e-a4e8-423c-8ca2-f552594242f8" released by "delete_volume" :: held 0.820s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['e457ecf3-df49-4989-bcec-585821cfd2af', '8674fa1b-1512-4084-b97b-70a7d0c0183f', 'ba611a76-abb9-48eb-b795-6fe44977d5db', 'cd7ec7fb-9c8f-430a-93ac-6334cc8a3e72'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:47 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:47 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-f5a1f60a-4e88-4898-85f6-055eb73a959f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-f5a1f60a-4e88-4898-85f6-055eb73a959f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-f5a1f60a-4e88-4898-85f6-055eb73a959f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-f5a1f60a-4e88-4898-85f6-055eb73a959f" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dcf21e-49e5-477f-a0b3-dd4b9f0002f2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:47 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77fb7e10-7066-4a3c-a436-2cb620aaf3ab tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-69ab593e-a4e8-423c-8ca2-f552594242f8-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:47 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f Jul 21 19:20:47 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:47 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:47 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f Jul 21 19:20:47 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:48 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f5a1f60a-4e88-4898-85f6-055eb73a959f" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-f5a1f60a-4e88-4898-85f6-055eb73a959f" released by "delete_volume" :: held 0.853s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['d9bd3f2e-78e0-4602-bd8b-b9ee0a693549', '8fb7332c-02ad-48c6-8549-d4062c48f3d1', '01710826-8cbe-4199-9f60-3729a243f347', 'f462550d-7baf-4fa7-a112-34feed8c6f44'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:48 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:48 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-5b9b87e9-df1a-4bc9-97aa-12a246f88cad-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-5b9b87e9-df1a-4bc9-97aa-12a246f88cad-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9081d99c-592a-4230-9b34-382a50545ba7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:48 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42b011d0-f15c-47d6-b8ea-9b502e359c91 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-f5a1f60a-4e88-4898-85f6-055eb73a959f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:48 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad Jul 21 19:20:48 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:49 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:49 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad Jul 21 19:20:49 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:49 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-5b9b87e9-df1a-4bc9-97aa-12a246f88cad" released by "delete_volume" :: held 0.801s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['944849e4-f974-4213-8f3e-5bd43d023a7c', '7ed8874d-3f3c-4a14-ac90-99842bf61030', '50b67b4e-5349-444f-94bb-71079ec795d7', '29185895-6f98-4da3-bf74-2f2ada51c09e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:49 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:49 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-15c71022-47e0-4df8-bfdb-b5e1e4b19be1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-15c71022-47e0-4df8-bfdb-b5e1e4b19be1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "cinder-quobyte-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ea5c7-e889-40c4-b89d-d3568490be6c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:49 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95429390-8079-41b2-a29c-cd1955acb2b0 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-5b9b87e9-df1a-4bc9-97aa-12a246f88cad-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:50 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 Jul 21 19:20:50 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:50 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:50 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1 Jul 21 19:20:50 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:50 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-quobyte-15c71022-47e0-4df8-bfdb-b5e1e4b19be1" released by "delete_volume" :: held 0.825s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Created reservations ['90b79653-344e-4509-8e1a-00a777cdd039', '1e35686d-93bb-4a22-9836-945894826d6f', 'd49ab161-88c8-4d0b-8a4f-64fb2eba7012', '2983354b-2047-4c47-8569-a278a47e82f8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:20:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:20:50 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:20:50 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:20:51 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 21 19:20:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:20:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:20:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Deleted volume successfully. Jul 21 19:20:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-07ff946e-2c86-446c-a685-90ccc62d51e5 tempest-CreateVolumesFromSourceVolumeTest-2097543937 None] Lock "cinder-15c71022-47e0-4df8-bfdb-b5e1e4b19be1-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:00 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=40,cinder:INSERT=11,cinder:UPDATE=62,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:01 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=21,cinder:UPDATE=76,cinder:SELECT=46,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Flow 'volume_create_manager' (a48d03c2-1860-4971-b0c3-829d076516b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e69fd1a-26e8-4715-8b99-ff7327849539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e69fd1a-26e8-4715-8b99-ff7327849539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-298206681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b515aa-1584-4853-b4d8-b5ea866a5c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adef9d8ba7bc40b3b2df74cb8c014d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:03Z,use_quota=True,user_id='7390a97dab8f4773a110256dc7391306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fde4943-5750-4a98-bbfb-2aec47148fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fde4943-5750-4a98-bbfb-2aec47148fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea17c443-14d4-4f38-8cf3-91c773683efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea17c443-14d4-4f38-8cf3-91c773683efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b515aa-1584-4853-b4d8-b5ea866a5c77', 'volume_name': 'volume-03b515aa-1584-4853-b4d8-b5ea866a5c77', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bb9027-d319-49b9-854c-9172280e5c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bb9027-d319-49b9-854c-9172280e5c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6231d-099d-4951-bbbb-45aef3f796e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume 03b515aa-1584-4853-b4d8-b5ea866a5c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b515aa-1584-4853-b4d8-b5ea866a5c77', 'volume_size': 1} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-298206681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b515aa-1584-4853-b4d8-b5ea866a5c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adef9d8ba7bc40b3b2df74cb8c014d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:03Z,use_quota=True,user_id='7390a97dab8f4773a110256dc7391306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Creating volume 03b515aa-1584-4853-b4d8-b5ea866a5c77 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:03 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 1073741824 Jul 21 19:21:03 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Flow 'volume_create_manager' (f9f412b5-5a39-47a9-876d-443d858f5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e1bf8-b4d6-45fd-a0d3-c8a23118f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e1bf8-b4d6-45fd-a0d3-c8a23118f154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1269238114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d079dd5a-bd27-4924-b382-eaeb605a8a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adef9d8ba7bc40b3b2df74cb8c014d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:04Z,use_quota=True,user_id='7390a97dab8f4773a110256dc7391306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a5686-4bd1-4a26-83cb-1e743b9558dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a5686-4bd1-4a26-83cb-1e743b9558dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342d38bf-bd8d-4a54-b173-8c59d4ec1eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342d38bf-bd8d-4a54-b173-8c59d4ec1eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd079dd5a-bd27-4924-b382-eaeb605a8a1a', 'volume_name': 'volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af4292f-0f03-45ea-93fa-192d1b79f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af4292f-0f03-45ea-93fa-192d1b79f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761c8177-773e-4e73-921a-9c7dac4f0122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume d079dd5a-bd27-4924-b382-eaeb605a8a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a', 'volume_size': 1} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:04 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 1073741824" returned: 0 in 0.656s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:04 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 Jul 21 19:21:04 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:04 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1269238114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d079dd5a-bd27-4924-b382-eaeb605a8a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adef9d8ba7bc40b3b2df74cb8c014d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:04Z,use_quota=True,user_id='7390a97dab8f4773a110256dc7391306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Creating volume d079dd5a-bd27-4924-b382-eaeb605a8a1a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f6231d-099d-4951-bbbb-45aef3f796e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b515aa-1584-4853-b4d8-b5ea866a5c77', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:04 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a 1073741824 Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b61187-86d8-4448-90e3-b4d712f59cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:04 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 (03b515aa-1584-4853-b4d8-b5ea866a5c77): created successfully Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b61187-86d8-4448-90e3-b4d712f59cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Flow 'volume_create_manager' (a48d03c2-1860-4971-b0c3-829d076516b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-83c9af0c-ca66-46b3-9033-94d708a8c6e0 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Created volume successfully. Jul 21 19:21:05 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a 1073741824" returned: 0 in 0.767s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:05 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a Jul 21 19:21:05 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:05 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761c8177-773e-4e73-921a-9c7dac4f0122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae20844-5a7a-4875-a0ca-155b06f5223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Volume volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a (d079dd5a-bd27-4924-b382-eaeb605a8a1a): created successfully Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae20844-5a7a-4875-a0ca-155b06f5223d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Flow 'volume_create_manager' (f9f412b5-5a39-47a9-876d-443d858f5632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b508d08e-b2fc-4727-b564-2dbf1afa3646 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Created volume successfully. Jul 21 19:21:15 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:15 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Flow 'volume_create_manager' (b7747372-16f1-4130-9320-8b5f59e78c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9e8250-9c5c-44eb-9c02-e463ae567145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba9e8250-9c5c-44eb-9c02-e463ae567145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1913049341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33035638-3b7e-48f6-9e68-be6eea89f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d9dae15f74529b3b11445a92674f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:17Z,use_quota=True,user_id='e07500c56c45455f9706fcd8b75346b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5788b06f-57d9-4eb9-99f2-d03f469d8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5788b06f-57d9-4eb9-99f2-d03f469d8424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1534b473-4ca9-44b1-9159-4d2e2ab1d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1534b473-4ca9-44b1-9159-4d2e2ab1d580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33035638-3b7e-48f6-9e68-be6eea89f94c', 'volume_name': 'volume-33035638-3b7e-48f6-9e68-be6eea89f94c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c00821-a728-49bb-8924-c5670f5d6038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c00821-a728-49bb-8924-c5670f5d6038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537eecbb-5939-43a8-a74a-0f99fe24458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Volume 33035638-3b7e-48f6-9e68-be6eea89f94c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33035638-3b7e-48f6-9e68-be6eea89f94c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 19:21:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Trying to clone 33035638-3b7e-48f6-9e68-be6eea89f94c from image be5d1921-2dfc-4e84-8720-ad78553464c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:21:18 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Image download 20.69 MB at 20.69 MB/s Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c8a8b-130b-4cf6-a9f0-5f6a66998602]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:18 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD Jul 21 19:21:18 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:18 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 is fetched for user e07500c56c45455f9706fcd8b75346b6. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79931877-719b-42cf-8264-f829a19eb8c3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:18 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD Jul 21 19:21:18 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:19 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1913049341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33035638-3b7e-48f6-9e68-be6eea89f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d9dae15f74529b3b11445a92674f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:21:17Z,use_quota=True,user_id='e07500c56c45455f9706fcd8b75346b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Creating volume 33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:21:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:19 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1073741824 Jul 21 19:21:19 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:19 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1073741824" returned: 0 in 0.543s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:19 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c Jul 21 19:21:19 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:20 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Attempting download of be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 33035638-3b7e-48f6-9e68-be6eea89f94c. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb0eb0c-68be-4657-bec2-62fb74e009f0]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:20 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz Jul 21 19:21:20 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:20 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:20 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz Jul 21 19:21:20 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:20 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz" returned: 1 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5d1921-2dfc-4e84-8720-ad78553464c1_c6zrxciz' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3986fb2-eb18-473f-9670-449578c838a2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:21 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD Jul 21 19:21:21 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:21 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:21 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] be5d1921-2dfc-4e84-8720-ad78553464c1 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:21:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:21 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c Jul 21 19:21:21 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:22 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c" returned: 0 in 1.628s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:22 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be5d1921-2dfc-4e84-8720-ad78553464c1_tgopfgwedevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:21:22 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Converted 112.00 MB image at 68.72 MB/s Jul 21 19:21:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:22 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1G Jul 21 19:21:22 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:23 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c 1G" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Downloaded image be5d1921-2dfc-4e84-8720-ad78553464c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}])) to volume 33035638-3b7e-48f6-9e68-be6eea89f94c successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Temporary image be5d1921-2dfc-4e84-8720-ad78553464c1 for user e07500c56c45455f9706fcd8b75346b6 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Marking volume 33035638-3b7e-48f6-9e68-be6eea89f94c as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Copying metadata from image be5d1921-2dfc-4e84-8720-ad78553464c1 to 33035638-3b7e-48f6-9e68-be6eea89f94c. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Creating volume glance metadata for volume 33035638-3b7e-48f6-9e68-be6eea89f94c backed by image be5d1921-2dfc-4e84-8720-ad78553464c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537eecbb-5939-43a8-a74a-0f99fe24458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33035638-3b7e-48f6-9e68-be6eea89f94c', 'volume_size': 1, 'image_id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5d1921-2dfc-4e84-8720-ad78553464c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd48f777710f4bdca8c01d9ad003c33b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be5d1921-2dfc-4e84-8720-ad78553464c1', 'created_at': datetime.datetime(2026, 7, 21, 16, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 16, 59, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5d1921-2dfc-4e84-8720-ad78553464c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7054b7-3b7c-4f60-83b6-590101dc7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:21:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Volume volume-33035638-3b7e-48f6-9e68-be6eea89f94c (33035638-3b7e-48f6-9e68-be6eea89f94c): created successfully Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7054b7-3b7c-4f60-83b6-590101dc7f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:21:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Flow 'volume_create_manager' (b7747372-16f1-4130-9320-8b5f59e78c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:21:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-32e215da-a2f2-4039-9cc2-21fcbb325804 tempest-TestShelveInstance-64577570 None] Created volume successfully. Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:25 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:21:25 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:26 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d733fa3d-4d7f-4a7e-b963-cf008154ee2f req-4e7c6aa3-56f0-460b-a0eb-7b7d4ace20ca tempest-TestShelveInstance-64577570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d733fa3d-4d7f-4a7e-b963-cf008154ee2f req-4e7c6aa3-56f0-460b-a0eb-7b7d4ace20ca tempest-TestShelveInstance-64577570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d733fa3d-4d7f-4a7e-b963-cf008154ee2f req-4e7c6aa3-56f0-460b-a0eb-7b7d4ace20ca tempest-TestShelveInstance-64577570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d733fa3d-4d7f-4a7e-b963-cf008154ee2f req-4e7c6aa3-56f0-460b-a0eb-7b7d4ace20ca tempest-TestShelveInstance-64577570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-33035638-3b7e-48f6-9e68-be6eea89f94c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '005f0858-952b-4538-9973-626383d11718', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:21:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d733fa3d-4d7f-4a7e-b963-cf008154ee2f req-4e7c6aa3-56f0-460b-a0eb-7b7d4ace20ca tempest-TestShelveInstance-64577570 None] attachment_update completed successfully. Jul 21 19:21:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=8,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:21:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f47d16b7-d831-435e-a8a8-d88e546cf27a req-b0443018-37d0-47db-9d02-8cc8cf54284f tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f47d16b7-d831-435e-a8a8-d88e546cf27a req-b0443018-37d0-47db-9d02-8cc8cf54284f tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f47d16b7-d831-435e-a8a8-d88e546cf27a req-b0443018-37d0-47db-9d02-8cc8cf54284f tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-f47d16b7-d831-435e-a8a8-d88e546cf27a req-b0443018-37d0-47db-9d02-8cc8cf54284f tempest-TestServerVolumeAttachmentScenario-1346182018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-03b515aa-1584-4853-b4d8-b5ea866a5c77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '149c71bb-7dc8-4e59-b084-d508b3ec536d', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:21:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-f47d16b7-d831-435e-a8a8-d88e546cf27a req-b0443018-37d0-47db-9d02-8cc8cf54284f tempest-TestServerVolumeAttachmentScenario-1346182018 None] attachment_update completed successfully. Jul 21 19:21:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0d4b7a6f-a728-4289-8957-dc03d9959594 req-c33c094f-1475-4342-b6c7-28c0336013b3 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0d4b7a6f-a728-4289-8957-dc03d9959594 req-c33c094f-1475-4342-b6c7-28c0336013b3 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0d4b7a6f-a728-4289-8957-dc03d9959594 req-c33c094f-1475-4342-b6c7-28c0336013b3 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0d4b7a6f-a728-4289-8957-dc03d9959594 req-c33c094f-1475-4342-b6c7-28c0336013b3 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '884c84b5-d65b-4685-8b45-4b0f52f69723', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:21:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0d4b7a6f-a728-4289-8957-dc03d9959594 req-c33c094f-1475-4342-b6c7-28c0336013b3 tempest-TestServerVolumeAttachmentScenario-1346182018 None] attachment_update completed successfully. Jul 21 19:21:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-c307dd86-21ca-4f1d-a131-58058e5ca121 req-7dbdb784-04bb-42e9-b509-8c2dbedc456a tempest-TestServerVolumeAttachmentScenario-1346182018 None] Terminate volume connection completed successfully. Jul 21 19:21:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-c307dd86-21ca-4f1d-a131-58058e5ca121 req-7dbdb784-04bb-42e9-b509-8c2dbedc456a tempest-TestServerVolumeAttachmentScenario-1346182018 None] Deleting attachment 884c84b5-d65b-4685-8b45-4b0f52f69723. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:21:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0473fbc3-4f49-46fc-9e56-34c13cc174c0 req-ad7ac195-2235-473a-9234-06f9244d1a07 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Terminate volume connection completed successfully. Jul 21 19:21:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0473fbc3-4f49-46fc-9e56-34c13cc174c0 req-ad7ac195-2235-473a-9234-06f9244d1a07 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Deleting attachment 149c71bb-7dc8-4e59-b084-d508b3ec536d. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "cinder-d079dd5a-bd27-4924-b382-eaeb605a8a1a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-d079dd5a-bd27-4924-b382-eaeb605a8a1a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "cinder-quobyte-d079dd5a-bd27-4924-b382-eaeb605a8a1a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-quobyte-d079dd5a-bd27-4924-b382-eaeb605a8a1a" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3828c19-9615-4147-b8e2-4f0e0a43a675]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:51 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a Jul 21 19:21:51 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:52 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:52 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a Jul 21 19:21:52 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:52 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d079dd5a-bd27-4924-b382-eaeb605a8a1a" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-quobyte-d079dd5a-bd27-4924-b382-eaeb605a8a1a" released by "delete_volume" :: held 0.615s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Created reservations ['6741fcb4-3993-45c9-964b-7ee62965afe3', 'b1b78830-e4fc-445b-a10f-27de0e3da2f5', 'b2118857-4623-46f4-87b4-8bab8ff741e5', '47353fd3-b530-4267-afed-534bfe59c007'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:52 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:21:52 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:52 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Deleted volume successfully. Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-150e3b16-71af-47f1-a150-52680ae4f722 tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-d079dd5a-bd27-4924-b382-eaeb605a8a1a-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "cinder-03b515aa-1584-4853-b4d8-b5ea866a5c77-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-03b515aa-1584-4853-b4d8-b5ea866a5c77-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "cinder-quobyte-03b515aa-1584-4853-b4d8-b5ea866a5c77" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-quobyte-03b515aa-1584-4853-b4d8-b5ea866a5c77" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83697484-803a-4429-9306-0d2905d7a01b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:21:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:52 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 Jul 21 19:21:52 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:53 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:53 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77 Jul 21 19:21:53 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:53 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-03b515aa-1584-4853-b4d8-b5ea866a5c77" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-quobyte-03b515aa-1584-4853-b4d8-b5ea866a5c77" released by "delete_volume" :: held 0.675s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Created reservations ['f8d2629a-01f3-414c-b5fb-28a18dc2f2c8', '98fd3b9d-a355-43fd-bfb1-3e6ff5cb7ddf', '679c1602-24ea-4b6e-96f1-aa50fbbf4496', '86cd4bf6-e440-4179-baf7-c33629d9cece'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:21:53 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:21:53 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:21:53 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:21:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Deleted volume successfully. Jul 21 19:21:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eee5f9a3-89b7-4cc1-b08c-f4a1d7f3a8bd tempest-TestServerVolumeAttachmentScenario-1346182018 None] Lock "cinder-03b515aa-1584-4853-b4d8-b5ea866a5c77-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:21:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-4f018553-6e8e-4a3e-9d25-3634574b1cb6 req-936866e2-89ba-4942-8500-c94b6cf8c012 tempest-TestShelveInstance-64577570 None] Terminate volume connection completed successfully. Jul 21 19:21:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-4f018553-6e8e-4a3e-9d25-3634574b1cb6 req-936866e2-89ba-4942-8500-c94b6cf8c012 tempest-TestShelveInstance-64577570 None] Deleting attachment 005f0858-952b-4538-9973-626383d11718. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:22:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-80ae1495-249d-4d51-a8b5-8b8925f4ff10 req-2fa98917-ff3f-476b-9299-e5eabbbfaabc tempest-TestShelveInstance-64577570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-80ae1495-249d-4d51-a8b5-8b8925f4ff10 req-2fa98917-ff3f-476b-9299-e5eabbbfaabc tempest-TestShelveInstance-64577570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-80ae1495-249d-4d51-a8b5-8b8925f4ff10 req-2fa98917-ff3f-476b-9299-e5eabbbfaabc tempest-TestShelveInstance-64577570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-80ae1495-249d-4d51-a8b5-8b8925f4ff10 req-2fa98917-ff3f-476b-9299-e5eabbbfaabc tempest-TestShelveInstance-64577570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7', 'name': 'volume-33035638-3b7e-48f6-9e68-be6eea89f94c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '938e5d7f-fc60-4f81-b362-3c2ff6f8b4ff', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 19:22:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-80ae1495-249d-4d51-a8b5-8b8925f4ff10 req-2fa98917-ff3f-476b-9299-e5eabbbfaabc tempest-TestShelveInstance-64577570 None] attachment_update completed successfully. Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (495940d0-84ce-4d88-924f-303f0f465cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee1a65c-15da-45ec-9ece-5273932c4512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee1a65c-15da-45ec-9ece-5273932c4512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-720198601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1399f753-d712-4453-baa5-160e9b3eb673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:05Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb22de7d-c752-4473-a133-95d097938170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb22de7d-c752-4473-a133-95d097938170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecced286-7cf9-43e5-a4f6-03c052163898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecced286-7cf9-43e5-a4f6-03c052163898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1399f753-d712-4453-baa5-160e9b3eb673', 'volume_name': 'volume-1399f753-d712-4453-baa5-160e9b3eb673', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2f4afd-cd97-49e5-b556-f58af595e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2f4afd-cd97-49e5-b556-f58af595e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1995d3-417b-439c-b13a-9f4e267a1238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume 1399f753-d712-4453-baa5-160e9b3eb673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1399f753-d712-4453-baa5-160e9b3eb673', 'volume_size': 1} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-720198601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1399f753-d712-4453-baa5-160e9b3eb673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:05Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume 1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:05 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 1073741824 Jul 21 19:22:05 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:06 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 1073741824" returned: 0 in 0.607s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:06 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 Jul 21 19:22:06 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:06 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1995d3-417b-439c-b13a-9f4e267a1238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1399f753-d712-4453-baa5-160e9b3eb673', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107d382d-d9bd-4e61-beeb-33254e16bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-1399f753-d712-4453-baa5-160e9b3eb673 (1399f753-d712-4453-baa5-160e9b3eb673): created successfully Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107d382d-d9bd-4e61-beeb-33254e16bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (495940d0-84ce-4d88-924f-303f0f465cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3fab21b3-a32a-45c6-95b1-94005f46c5ae tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating offline snapshot 124a8222-58e3-4a83-ae54-a828d46fcbbe of volume 1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:22:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe670b9e-abdc-4005-8bb5-621b4b6fea37]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:07 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 Jul 21 19:22:07 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:08 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:08 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe 1G Jul 21 19:22:08 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:08 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe 1G" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399f753-d712-4453-baa5-160e9b3eb673 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:08 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399f753-d712-4453-baa5-160e9b3eb673 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe Jul 21 19:22:08 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:08 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1399f753-d712-4453-baa5-160e9b3eb673 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe is being set with open permissions: ugo+rw Jul 21 19:22:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:09 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe Jul 21 19:22:09 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:09 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:09 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info Jul 21 19:22:09 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:09 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info is being set with open permissions: ugo+rw Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:09 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info Jul 21 19:22:09 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:09 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.info" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-37155242-fbac-4a91-9312-6df2b07abdf8 tempest-CreateVolumesFromSnapshotTest-562370961 None] Create snapshot completed successfully Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (88358c8a-a19b-450c-807a-c585a0cd01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42de5cd-b13e-4428-b940-81b5bd750551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42de5cd-b13e-4428-b940-81b5bd750551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200379421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146a66cb-34d8-4c06-87b2-48000a0223fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:11Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb76131-362f-4acd-bc6b-38c17a0814b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb76131-362f-4acd-bc6b-38c17a0814b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdfc910-ca77-4d1c-adc7-35eaf030c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdfc910-ca77-4d1c-adc7-35eaf030c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146a66cb-34d8-4c06-87b2-48000a0223fd', 'volume_name': 'volume-146a66cb-34d8-4c06-87b2-48000a0223fd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b962b3-8f1e-4f78-8792-b6aa04932d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b962b3-8f1e-4f78-8792-b6aa04932d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed419bea-ff06-418b-8ea5-2afb5938f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume 146a66cb-34d8-4c06-87b2-48000a0223fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146a66cb-34d8-4c06-87b2-48000a0223fd', 'volume_size': 1} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-200379421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146a66cb-34d8-4c06-87b2-48000a0223fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:11Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume 146a66cb-34d8-4c06-87b2-48000a0223fd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:11 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd 1073741824 Jul 21 19:22:11 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (2ec628be-f88d-410f-9069-baa7cb83b75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b97a8-2bd7-41ca-8021-9a6bb9f635c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b97a8-2bd7-41ca-8021-9a6bb9f635c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405110188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b652c-b74c-4463-9663-02845ba0b385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:12Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05824f1c-f2a9-4539-92cc-9fa1cb2da69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05824f1c-f2a9-4539-92cc-9fa1cb2da69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29edab46-2038-482c-91e2-0ff6c407a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29edab46-2038-482c-91e2-0ff6c407a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57b652c-b74c-4463-9663-02845ba0b385', 'volume_name': 'volume-b57b652c-b74c-4463-9663-02845ba0b385', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20eeb3e-4233-454b-ac20-a62806b9aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20eeb3e-4233-454b-ac20-a62806b9aff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846cfa7d-970f-41ed-b535-4354d61adea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume b57b652c-b74c-4463-9663-02845ba0b385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57b652c-b74c-4463-9663-02845ba0b385', 'volume_size': 1} Jul 21 19:22:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:12 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd 1073741824" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:12 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd Jul 21 19:22:12 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (93da4a25-36fd-473f-88e6-4c58c0306766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249b5232-bb66-4ad5-98a0-c0f0f7a74946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249b5232-bb66-4ad5-98a0-c0f0f7a74946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705677544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6281cdd9-e91a-4418-8647-d70d24f0402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:12Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11cd262-6b86-42ca-beff-956099ba8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11cd262-6b86-42ca-beff-956099ba8616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bea6b35-fe95-48b4-a4b2-bca9ff0f8c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bea6b35-fe95-48b4-a4b2-bca9ff0f8c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6281cdd9-e91a-4418-8647-d70d24f0402a', 'volume_name': 'volume-6281cdd9-e91a-4418-8647-d70d24f0402a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0070d7-ddd1-44c4-8652-a5af64979587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0070d7-ddd1-44c4-8652-a5af64979587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09089332-deb2-4691-9171-9b6bd418410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume 6281cdd9-e91a-4418-8647-d70d24f0402a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6281cdd9-e91a-4418-8647-d70d24f0402a', 'volume_size': 1} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405110188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57b652c-b74c-4463-9663-02845ba0b385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:12Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume b57b652c-b74c-4463-9663-02845ba0b385 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed419bea-ff06-418b-8ea5-2afb5938f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146a66cb-34d8-4c06-87b2-48000a0223fd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bc5704-53ff-418e-b805-d4b064c38cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 1073741824 Jul 21 19:22:12 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-146a66cb-34d8-4c06-87b2-48000a0223fd (146a66cb-34d8-4c06-87b2-48000a0223fd): created successfully Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bc5704-53ff-418e-b805-d4b064c38cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (88358c8a-a19b-450c-807a-c585a0cd01c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-167d566d-346d-48e3-87f0-7eae21933e40 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (741fe74a-4a7a-43be-87f4-c29bc1065e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cc6e47-1bd6-46c3-9fc1-2ac00542263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cc6e47-1bd6-46c3-9fc1-2ac00542263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946340200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:13Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ed111f-dd3e-48fd-b813-61813b8ec40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ed111f-dd3e-48fd-b813-61813b8ec40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3d86fe-5249-4bae-a3be-2db0a2584af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3d86fe-5249-4bae-a3be-2db0a2584af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8', 'volume_name': 'volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8724b035-f8e6-47a2-99e2-6e59ddc1d1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8724b035-f8e6-47a2-99e2-6e59ddc1d1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ba3153-6e86-42c9-93f8-9ac234213c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8', 'volume_size': 1} Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:12 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 1073741824" returned: 0 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:13 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 Jul 21 19:22:13 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (e6f4cbee-1d52-4520-a9dc-111bd1a4adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244bf92-464b-4118-bfee-740de437115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0244bf92-464b-4118-bfee-740de437115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481935847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229e6251-97c7-4330-953b-c5c064c9ef55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:13Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f50ee-b68a-411b-bf39-9f9bdec9f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f50ee-b68a-411b-bf39-9f9bdec9f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca588238-b007-492d-abbd-ad5d30bfb7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca588238-b007-492d-abbd-ad5d30bfb7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229e6251-97c7-4330-953b-c5c064c9ef55', 'volume_name': 'volume-229e6251-97c7-4330-953b-c5c064c9ef55', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d708ef-c551-40d8-a7b0-4ce7725ea914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d708ef-c551-40d8-a7b0-4ce7725ea914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67caf35b-7b8a-4738-92cf-e4ea92dfc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume 229e6251-97c7-4330-953b-c5c064c9ef55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229e6251-97c7-4330-953b-c5c064c9ef55', 'volume_size': 1} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:13 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705677544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6281cdd9-e91a-4418-8647-d70d24f0402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:12Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume 6281cdd9-e91a-4418-8647-d70d24f0402a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846cfa7d-970f-41ed-b535-4354d61adea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57b652c-b74c-4463-9663-02845ba0b385', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a 1073741824 Jul 21 19:22:13 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01741c20-ea72-4278-a680-b787502b00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-b57b652c-b74c-4463-9663-02845ba0b385 (b57b652c-b74c-4463-9663-02845ba0b385): created successfully Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01741c20-ea72-4278-a680-b787502b00c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (2ec628be-f88d-410f-9069-baa7cb83b75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-16d021ab-c577-4538-b270-615817de6bde tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:13 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a 1073741824" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:13 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a Jul 21 19:22:13 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:14 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946340200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:13Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:14 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 1073741824 Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09089332-deb2-4691-9171-9b6bd418410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6281cdd9-e91a-4418-8647-d70d24f0402a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:14 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679b0cd4-321a-4d88-9350-66addf178ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-6281cdd9-e91a-4418-8647-d70d24f0402a (6281cdd9-e91a-4418-8647-d70d24f0402a): created successfully Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679b0cd4-321a-4d88-9350-66addf178ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (93da4a25-36fd-473f-88e6-4c58c0306766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bdf2dc7e-b168-41f9-b33b-b0445aaaac90 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:14 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 1073741824" returned: 0 in 0.466s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:14 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 Jul 21 19:22:14 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:14 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481935847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229e6251-97c7-4330-953b-c5c064c9ef55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeb1dc1e33f4aa78236bd510069b276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:13Z,use_quota=True,user_id='48a43ec9f05841189627ad23a47f66c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Creating volume 229e6251-97c7-4330-953b-c5c064c9ef55 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ba3153-6e86-42c9-93f8-9ac234213c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:14 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 1073741824 Jul 21 19:22:14 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e108f-0799-4b11-9ba6-4d579506e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 (e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8): created successfully Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277e108f-0799-4b11-9ba6-4d579506e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (741fe74a-4a7a-43be-87f4-c29bc1065e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3eeefc76-8c94-4d6d-8fa0-29a522131575 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:15 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 1073741824" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:15 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 Jul 21 19:22:15 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:15 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67caf35b-7b8a-4738-92cf-e4ea92dfc3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229e6251-97c7-4330-953b-c5c064c9ef55', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904cf144-80b1-44ec-863f-c53833c7d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Volume volume-229e6251-97c7-4330-953b-c5c064c9ef55 (229e6251-97c7-4330-953b-c5c064c9ef55): created successfully Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904cf144-80b1-44ec-863f-c53833c7d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Flow 'volume_create_manager' (e6f4cbee-1d52-4520-a9dc-111bd1a4adaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5c3967f7-6f1c-46d8-a0e5-e5a2ed89d428 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created volume successfully. Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-229e6251-97c7-4330-953b-c5c064c9ef55-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-229e6251-97c7-4330-953b-c5c064c9ef55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-229e6251-97c7-4330-953b-c5c064c9ef55" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-229e6251-97c7-4330-953b-c5c064c9ef55" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692014f-7c0a-40c0-826f-fc606fd9d3af]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:16 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 Jul 21 19:22:16 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:17 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:17 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55 Jul 21 19:22:17 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:17 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-229e6251-97c7-4330-953b-c5c064c9ef55" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-229e6251-97c7-4330-953b-c5c064c9ef55" released by "delete_volume" :: held 0.673s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['397039b2-f90b-44f6-95f0-1d7adf117135', '20a79934-94ec-452a-91fa-e7949bcc1e70', 'ace0481a-4e17-49ce-abb4-8258201bc56f', '4d261aaf-3a30-42be-b32b-f64c2f0607ac'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:17 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:17 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:17 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ec8204e-69fd-49c8-952a-8c85630fce3e tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-229e6251-97c7-4330-953b-c5c064c9ef55-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dea8b9-b859-472f-9155-ac054462d7c8]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:18 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 Jul 21 19:22:18 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:18 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:18 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8 Jul 21 19:22:18 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:18 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8" released by "delete_volume" :: held 0.634s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['eaa57146-2764-4de4-a32b-eb3bd34aacde', '114e6a2b-2096-4fad-9aed-3a99c009d09d', '40f28706-be80-4509-8332-3ec027b21ec0', '6362fe6c-e8ef-416c-98d2-0489a59fcdb4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:18 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:18 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:18 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7685961a-0322-4a60-948d-65ae2ba8f5b1 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-e9007c15-1ac6-4ba0-a4ae-5a92d455e7c8-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-6281cdd9-e91a-4418-8647-d70d24f0402a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-6281cdd9-e91a-4418-8647-d70d24f0402a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-6281cdd9-e91a-4418-8647-d70d24f0402a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-6281cdd9-e91a-4418-8647-d70d24f0402a" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1353d-234d-4b3c-ac1a-a3ee4abcbe7c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:19 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a Jul 21 19:22:19 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:19 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:19 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a Jul 21 19:22:19 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:19 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6281cdd9-e91a-4418-8647-d70d24f0402a" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-6281cdd9-e91a-4418-8647-d70d24f0402a" released by "delete_volume" :: held 0.652s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['1758c2e9-d60c-4cb1-93ac-2a31c0cfa77b', '9fd02d2f-c935-47af-b7d4-89ecb1248c2b', 'e26fc9d5-a12c-4bcc-bf52-7a57dc1971d3', '17fe266e-08bf-44ba-ab0c-d8b929047a1f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:19 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:19 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:20 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8f2e2d2-5b8f-4542-8029-2b18bce88fec tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-6281cdd9-e91a-4418-8647-d70d24f0402a-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-b57b652c-b74c-4463-9663-02845ba0b385-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-b57b652c-b74c-4463-9663-02845ba0b385-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-b57b652c-b74c-4463-9663-02845ba0b385" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-b57b652c-b74c-4463-9663-02845ba0b385" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[174862d6-b08f-473c-9ecb-111b37fcf093]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:20 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 Jul 21 19:22:20 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:20 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:20 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385 Jul 21 19:22:20 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:20 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b57b652c-b74c-4463-9663-02845ba0b385" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-b57b652c-b74c-4463-9663-02845ba0b385" released by "delete_volume" :: held 0.645s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['a7ff9ea9-a0d6-4386-b80f-958e224513ac', 'c487cbdf-5bc4-463c-9ddd-432bee5e2ae9', '2a3d407b-a990-4a2d-9221-8665e894ae62', '2ae98c85-2f29-4994-a750-d41724c2bec7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:21 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:21 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:21 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-311d180a-2eda-4291-8116-34843ffac2e4 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-b57b652c-b74c-4463-9663-02845ba0b385-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-146a66cb-34d8-4c06-87b2-48000a0223fd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-146a66cb-34d8-4c06-87b2-48000a0223fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-146a66cb-34d8-4c06-87b2-48000a0223fd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-146a66cb-34d8-4c06-87b2-48000a0223fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b4844-a16d-4ec2-b192-4f935463f93e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:21 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd Jul 21 19:22:21 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:21 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:21 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd Jul 21 19:22:21 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:22 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-146a66cb-34d8-4c06-87b2-48000a0223fd" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-146a66cb-34d8-4c06-87b2-48000a0223fd" released by "delete_volume" :: held 0.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['83bc7494-bf90-4cc0-a20b-807df25c281d', '28db2af5-5103-4490-89dd-51b36bc08b28', 'e0b077f8-e47b-46d7-97e9-fabdad197fc9', '5b9bbe2a-7481-46d9-b30b-c1c7d0cae877'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:22 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:22 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:22 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a9ca4a50-ec44-419d-a0db-74ba735ecbd5 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-146a66cb-34d8-4c06-87b2-48000a0223fd-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-124a8222-58e3-4a83-ae54-a828d46fcbbe-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-124a8222-58e3-4a83-ae54-a828d46fcbbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-124a8222-58e3-4a83-ae54-a828d46fcbbe" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-124a8222-58e3-4a83-ae54-a828d46fcbbe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleting offline snapshot 124a8222-58e3-4a83-ae54-a828d46fcbbe of volume 1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] snapshot_file for this snap is: volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc205d06-98cb-4312-9391-f7b6c5127a22]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:22 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe Jul 21 19:22:22 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:22 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1399f753-d712-4453-baa5-160e9b3eb673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f227da4-ced9-46d5-ad97-9d029169ec62]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:23 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 Jul 21 19:22:23 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:23 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:23 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe Jul 21 19:22:23 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:23 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:23 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe Jul 21 19:22:23 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:23 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673.124a8222-58e3-4a83-ae54-a828d46fcbbe" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-124a8222-58e3-4a83-ae54-a828d46fcbbe" released by "_delete_snapshot" :: held 1.370s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" released by "delete_snapshot" :: held 1.394s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['1649f297-85d5-43c5-9e36-643e757bc0e5', 'f6588c47-5b05-4db7-97bd-dd5967b13c6f', 'e30f2950-d463-43b6-b269-94d96932c223', '00e7393e-063b-404e-a5a2-1c089354c093'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Delete snapshot completed successfully. Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-53f1eddc-3dc0-434b-af21-d5ccdb35d448 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-124a8222-58e3-4a83-ae54-a828d46fcbbe-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-1399f753-d712-4453-baa5-160e9b3eb673-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-1399f753-d712-4453-baa5-160e9b3eb673-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415ff5b-7cf2-48f8-97c5-11a8d0cac85f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:24 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 Jul 21 19:22:24 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:25 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:25 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673 Jul 21 19:22:25 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:25 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1399f753-d712-4453-baa5-160e9b3eb673" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-quobyte-1399f753-d712-4453-baa5-160e9b3eb673" released by "delete_volume" :: held 0.668s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Created reservations ['ecccabbf-3cc8-4679-bdb3-d33d58020e98', 'a916bbba-727b-45fe-bb50-13b7cc4900da', '13d66c20-89b4-439f-8d80-6cd190b6afb2', '26057d4e-d5b5-4e5b-a4fd-35fab129876c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:25 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:25 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:25 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Deleted volume successfully. Jul 21 19:22:25 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:25 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-590addb5-4bcb-4b89-96d4-1e3c4d17ff47 tempest-CreateVolumesFromSnapshotTest-562370961 None] Lock "cinder-1399f753-d712-4453-baa5-160e9b3eb673-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:26 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:22:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:22:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Flow 'volume_create_manager' (de32a8f8-cd72-4268-a848-c6262348600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf9f18-8d7f-4d6c-b54d-eb0b09a5f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf9f18-8d7f-4d6c-b54d-eb0b09a5f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-698967529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419dc997-d256-4cc5-939e-c3a20d2a9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c217ce9348144f08891c1a30f48db3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:29Z,use_quota=True,user_id='a9f123a2a1874d06bfb753995bb1a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a04b9e-a450-4aac-9ea8-237007e4f2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a04b9e-a450-4aac-9ea8-237007e4f2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce51d079-f019-43d3-8195-effbf3903a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce51d079-f019-43d3-8195-effbf3903a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419dc997-d256-4cc5-939e-c3a20d2a9b58', 'volume_name': 'volume-419dc997-d256-4cc5-939e-c3a20d2a9b58', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5021ca8-226f-4a47-a83b-ea4841565765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5021ca8-226f-4a47-a83b-ea4841565765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5618ee10-2871-4e49-9917-6e4747ed3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Volume 419dc997-d256-4cc5-939e-c3a20d2a9b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419dc997-d256-4cc5-939e-c3a20d2a9b58', 'volume_size': 1} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-698967529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419dc997-d256-4cc5-939e-c3a20d2a9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c217ce9348144f08891c1a30f48db3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:29Z,use_quota=True,user_id='a9f123a2a1874d06bfb753995bb1a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Creating volume 419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:29 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 1073741824 Jul 21 19:22:29 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-42a056e5-4181-4fa0-8ab0-8b0f99ac136a tempest-TestShelveInstance-64577570 None] Terminate volume connection completed successfully. Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-42a056e5-4181-4fa0-8ab0-8b0f99ac136a tempest-TestShelveInstance-64577570 None] Deleting attachment 938e5d7f-fc60-4f81-b362-3c2ff6f8b4ff. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Acquiring lock "cinder-33035638-3b7e-48f6-9e68-be6eea89f94c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:29 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 1073741824" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "cinder-33035638-3b7e-48f6-9e68-be6eea89f94c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Acquiring lock "cinder-quobyte-33035638-3b7e-48f6-9e68-be6eea89f94c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:29 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:29 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "cinder-quobyte-33035638-3b7e-48f6-9e68-be6eea89f94c" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2bc0a-eddd-4e7d-8176-118adb3ec9fb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:30 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c Jul 21 19:22:30 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:30 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5618ee10-2871-4e49-9917-6e4747ed3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419dc997-d256-4cc5-939e-c3a20d2a9b58', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec6e56-1dc4-479a-ab80-8034c634907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Volume volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 (419dc997-d256-4cc5-939e-c3a20d2a9b58): created successfully Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ec6e56-1dc4-479a-ab80-8034c634907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Flow 'volume_create_manager' (de32a8f8-cd72-4268-a848-c6262348600e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a66c1f2-d9ad-4b51-8aa5-3b770206bb66 tempest-VolumeDependencyTests-1495805158 None] Created volume successfully. Jul 21 19:22:30 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:30 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c Jul 21 19:22:30 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:30 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-33035638-3b7e-48f6-9e68-be6eea89f94c" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "cinder-quobyte-33035638-3b7e-48f6-9e68-be6eea89f94c" released by "delete_volume" :: held 0.723s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.quota [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Created reservations ['8e9db7e4-c744-432f-9f0b-fb9135f04b2e', '27cc6eec-4f3f-4d1f-96b3-84664c25cb95', 'f9e6ec6a-d623-4465-a93b-d8ae091b772e', 'd1ed17e3-3309-419c-a9b8-163323576d01'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:30 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:30 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:31 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG cinder.manager [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Deleted volume successfully. Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-13abec3f-cb73-4532-a82c-4a5ad8219196 req-36e3abb3-762f-4c95-a94f-3176931664dd tempest-TestShelveInstance-64577570 None] Lock "cinder-33035638-3b7e-48f6-9e68-be6eea89f94c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Creating offline snapshot 36d928bf-92fb-4181-a7e7-eff6bcd5fb5c of volume 419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88cf1d-32bb-4622-8647-ef545435fd8f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:31 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:31 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:31 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:31 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c 1G Jul 21 19:22:31 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:32 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c 1G" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:32 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:32 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:32 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c is being set with open permissions: ugo+rw Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:32 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:32 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:32 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:32 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info Jul 21 19:22:32 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:33 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:33 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info is being set with open permissions: ugo+rw Jul 21 19:22:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:33 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info Jul 21 19:22:33 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:33 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.info" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5353fd0d-9f30-4049-92b0-8bb4da0356a7 tempest-VolumeDependencyTests-1495805158 None] Create snapshot completed successfully Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Flow 'volume_create_manager' (4567dfb1-ed50-4dc6-bb75-402ede925d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab304990-3a5f-4fa0-936a-85a75af08f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab304990-3a5f-4fa0-936a-85a75af08f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1675358775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a546c30f-ee37-43e5-a927-52def0eecb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c217ce9348144f08891c1a30f48db3e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36d928bf-92fb-4181-a7e7-eff6bcd5fb5c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:35Z,use_quota=True,user_id='a9f123a2a1874d06bfb753995bb1a3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17824f42-f4d5-44ab-8cee-1e4428ab18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17824f42-f4d5-44ab-8cee-1e4428ab18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216f96be-33c5-4fc0-a92e-242d0a9969ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216f96be-33c5-4fc0-a92e-242d0a9969ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a546c30f-ee37-43e5-a927-52def0eecb14', 'volume_name': 'volume-a546c30f-ee37-43e5-a927-52def0eecb14', 'volume_size': 1, 'snapshot_id': '36d928bf-92fb-4181-a7e7-eff6bcd5fb5c'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d462e346-6d71-478e-9c5c-26d1fb8095b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d462e346-6d71-478e-9c5c-26d1fb8095b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ac6cb7-73a2-4dfb-b30a-b796f5ac1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Volume a546c30f-ee37-43e5-a927-52def0eecb14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a546c30f-ee37-43e5-a927-52def0eecb14', 'volume_size': 1, 'snapshot_id': '36d928bf-92fb-4181-a7e7-eff6bcd5fb5c'} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-a546c30f-ee37-43e5-a927-52def0eecb14" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-a546c30f-ee37-43e5-a927-52def0eecb14" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Creating volume a546c30f-ee37-43e5-a927-52def0eecb14 from snapshot 36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] snapshot: 36d928bf-92fb-4181-a7e7-eff6bcd5fb5c, volume: a546c30f-ee37-43e5-a927-52def0eecb14, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd6282-75ad-4315-ad37-f8b9906ece07]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:35 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:35 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:35 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-419dc997-d256-4cc5-939e-c3a20d2a9b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec1220-b5eb-41e5-9a11-1e5d693db3cb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:35 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:35 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:36 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:36 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:22:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:36 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 Jul 21 19:22:36 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:41 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14" returned: 0 in 5.184s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51d9267-558f-4023-ba1e-28e286801242]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:41 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:41 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:41 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.568s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:22:41 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Converted 1024.00 MB image at 197.48 MB/s Jul 21 19:22:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 is being set with open permissions: ugo+rw Jul 21 19:22:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:41 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 Jul 21 19:22:41 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:42 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" released by "_copy_volume_from_snapshot" :: held 6.922s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-a546c30f-ee37-43e5-a927-52def0eecb14" released by "_create_volume_from_snapshot" :: held 6.951s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.969s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=100,cinder:UPDATE=111,cinder:INSERT=25,cinder:DELETE=12 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=96,cinder:UPDATE=104,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ac6cb7-73a2-4dfb-b30a-b796f5ac1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a546c30f-ee37-43e5-a927-52def0eecb14', 'volume_size': 1, 'snapshot_id': '36d928bf-92fb-4181-a7e7-eff6bcd5fb5c'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc07a2db-8d5e-430e-acc7-b60809a1242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Volume volume-a546c30f-ee37-43e5-a927-52def0eecb14 (a546c30f-ee37-43e5-a927-52def0eecb14): created successfully Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc07a2db-8d5e-430e-acc7-b60809a1242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Flow 'volume_create_manager' (4567dfb1-ed50-4dc6-bb75-402ede925d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-986fb3c3-30f5-46f6-9cd7-5e4a1205040e tempest-VolumeDependencyTests-1495805158 None] Created volume successfully. Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Deleting offline snapshot 36d928bf-92fb-4181-a7e7-eff6bcd5fb5c of volume 419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] snapshot_file for this snap is: volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5f38c-a24b-4aed-a0a2-0db809f9fac5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:43 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:43 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:43 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-419dc997-d256-4cc5-939e-c3a20d2a9b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889cdcd-bf1c-4f7d-8e38-9b576df59ede]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:43 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:43 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:43 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:43 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:43 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:44 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:44 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c Jul 21 19:22:44 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:44 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58.36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c" released by "_delete_snapshot" :: held 1.420s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" released by "delete_snapshot" :: held 1.445s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Created reservations ['4f3b3424-8bfe-4e93-96c0-a144d6aa9f93', '34698e4e-c08f-4157-a2b2-5b3c1c36dccd', '66fb133d-b7bc-46a5-afe4-aea1ab2cad2d', 'fd2c1af2-0e29-420e-b3e9-e52e4130f4c4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Delete snapshot completed successfully. Jul 21 19:22:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e1ab90d-4181-4c2c-9ae8-dc88a59601e3 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-36d928bf-92fb-4181-a7e7-eff6bcd5fb5c-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-419dc997-d256-4cc5-939e-c3a20d2a9b58-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-419dc997-d256-4cc5-939e-c3a20d2a9b58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d228843c-49c5-4b0b-a5c9-39139bfe09c5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:45 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:45 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:45 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:45 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58 Jul 21 19:22:45 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:45 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-419dc997-d256-4cc5-939e-c3a20d2a9b58" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-419dc997-d256-4cc5-939e-c3a20d2a9b58" released by "delete_volume" :: held 0.672s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Created reservations ['ff2fb7ad-5604-44a1-8ebc-88c5b4387b32', '2ed18aea-1c2a-470b-971e-b7b455904a52', '05c8c1b7-b5c2-4084-a996-e0992947c1e3', 'd0bddd24-1939-4dbf-81b4-00bf58bc77c8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:45 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:46 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:46 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Flow 'volume_create_manager' (d6c5a155-286d-4961-bdcf-dd4b0ea8bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd41e931-bf18-4ba7-9e76-a825d2a8d18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Deleted volume successfully. Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd41e931-bf18-4ba7-9e76-a825d2a8d18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645a34c2-db4d-483b-aa98-a05f9d13b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ae40351d014b149007704f1e5afa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:46Z,use_quota=True,user_id='dc5e7ce659b64cc7856f4fb3b3e25d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b5fcb-2482-4a5a-bcb7-5058390e2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9b5fcb-2482-4a5a-bcb7-5058390e2a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ef3256-2583-48e4-b19f-03753b84694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-a546c30f-ee37-43e5-a927-52def0eecb14-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62a3ccaf-2742-4352-9bae-814dea8bd657 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-419dc997-d256-4cc5-939e-c3a20d2a9b58-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-a546c30f-ee37-43e5-a927-52def0eecb14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c3acaf-18a6-48cb-b253-4104ce835b09]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ef3256-2583-48e4-b19f-03753b84694a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '645a34c2-db4d-483b-aa98-a05f9d13b572', 'volume_name': 'volume-645a34c2-db4d-483b-aa98-a05f9d13b572', 'volume_size': 1, 'image_id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d35d0037816f992c4a561de390683fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6ae40351d014b149007704f1e5afa58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c44aa0d0dedfc40e1943a966a72bed999c6df438a851b4c71be43778fad9e655f0af5ba310a4eba9cd39787261c111d2d8cfaed99981c3eb2833e2717dc87568', 'id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'created_at': datetime.datetime(2026, 7, 21, 17, 22, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 22, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:46 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 Jul 21 19:22:46 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a6a4ee-1ee8-44b8-b7a8-30aeb0272288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a6a4ee-1ee8-44b8-b7a8-30aeb0272288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc38f510-7d4f-48f3-b46a-81f83c72fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Volume 645a34c2-db4d-483b-aa98-a05f9d13b572: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-645a34c2-db4d-483b-aa98-a05f9d13b572', 'volume_size': 1, 'image_id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d35d0037816f992c4a561de390683fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6ae40351d014b149007704f1e5afa58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c44aa0d0dedfc40e1943a966a72bed999c6df438a851b4c71be43778fad9e655f0af5ba310a4eba9cd39787261c111d2d8cfaed99981c3eb2833e2717dc87568', 'id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'created_at': datetime.datetime(2026, 7, 21, 17, 22, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 22, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a/file', 'properties': {}}, 'image_service': } Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Trying to clone 645a34c2-db4d-483b-aa98-a05f9d13b572 from image f86f99c1-e5de-42a5-ba17-40bf80bab81a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:22:46 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b26e4-7320-448e-b8e2-7f406151a732]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:46 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:46 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:46 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:46 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14 Jul 21 19:22:46 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:47 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:47 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a546c30f-ee37-43e5-a927-52def0eecb14" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-quobyte-a546c30f-ee37-43e5-a927-52def0eecb14" released by "delete_volume" :: held 0.681s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Created reservations ['392cd8fe-b7b0-4e27-8bfa-06b3e7ad7a2b', 'a333f2e5-edf3-4fbb-8b1f-0d27190c3b1c', '6657555f-5b89-42a2-bbb1-088f3ab50529', '3911cd63-2a42-4506-be03-d30abae06781'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:47 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:47 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:47 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:47 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:47 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Temporary image f86f99c1-e5de-42a5-ba17-40bf80bab81a is fetched for user dc5e7ce659b64cc7856f4fb3b3e25d6f. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:22:47 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Deleted volume successfully. Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3782a8-d621-4414-8adf-75ca3a1e5705]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45974c6b-3899-4e99-b599-1a6f72bbf627 tempest-VolumeDependencyTests-1495805158 None] Lock "cinder-a546c30f-ee37-43e5-a927-52def0eecb14-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:47 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:47 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:47 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:47 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:47 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:48 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645a34c2-db4d-483b-aa98-a05f9d13b572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ae40351d014b149007704f1e5afa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:46Z,use_quota=True,user_id='dc5e7ce659b64cc7856f4fb3b3e25d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Creating volume 645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:48 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1073741824 Jul 21 19:22:48 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:48 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1073741824" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:48 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 Jul 21 19:22:48 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:48 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:48 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Attempting download of f86f99c1-e5de-42a5-ba17-40bf80bab81a ((None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}])) to volume 645a34c2-db4d-483b-aa98-a05f9d13b572. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f51b280-dfa9-4454-be6c-ba1307229067]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:49 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l Jul 21 19:22:49 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:49 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:49 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l Jul 21 19:22:49 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:49 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l" returned: 1 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f86f99c1-e5de-42a5-ba17-40bf80bab81a_59b0396l' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc322b24-3490-4a40-9f01-c97b820565b1]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:49 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:49 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:50 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:50 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD Jul 21 19:22:50 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:50 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] f86f99c1-e5de-42a5-ba17-40bf80bab81a was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:50 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 Jul 21 19:22:50 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:50 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f86f99c1-e5de-42a5-ba17-40bf80bab81a_cek0aqsadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:22:50 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:22:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:50 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1G Jul 21 19:22:50 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:51 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 1G" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Downloaded image f86f99c1-e5de-42a5-ba17-40bf80bab81a ((None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}])) to volume 645a34c2-db4d-483b-aa98-a05f9d13b572 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Temporary image f86f99c1-e5de-42a5-ba17-40bf80bab81a for user dc5e7ce659b64cc7856f4fb3b3e25d6f is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Marking volume 645a34c2-db4d-483b-aa98-a05f9d13b572 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Copying metadata from image f86f99c1-e5de-42a5-ba17-40bf80bab81a to 645a34c2-db4d-483b-aa98-a05f9d13b572. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Creating volume glance metadata for volume 645a34c2-db4d-483b-aa98-a05f9d13b572 backed by image f86f99c1-e5de-42a5-ba17-40bf80bab81a with: {'image_id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8d35d0037816f992c4a561de390683fd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc38f510-7d4f-48f3-b46a-81f83c72fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645a34c2-db4d-483b-aa98-a05f9d13b572', 'volume_size': 1, 'image_id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8d35d0037816f992c4a561de390683fd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a6ae40351d014b149007704f1e5afa58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c44aa0d0dedfc40e1943a966a72bed999c6df438a851b4c71be43778fad9e655f0af5ba310a4eba9cd39787261c111d2d8cfaed99981c3eb2833e2717dc87568', 'id': 'f86f99c1-e5de-42a5-ba17-40bf80bab81a', 'created_at': datetime.datetime(2026, 7, 21, 17, 22, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 22, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f86f99c1-e5de-42a5-ba17-40bf80bab81a/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b6d632-007c-4abe-ad1b-7df05b85f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Volume volume-645a34c2-db4d-483b-aa98-a05f9d13b572 (645a34c2-db4d-483b-aa98-a05f9d13b572): created successfully Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b6d632-007c-4abe-ad1b-7df05b85f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Flow 'volume_create_manager' (d6c5a155-286d-4961-bdcf-dd4b0ea8bada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1fcdc94d-b9cc-40ca-9083-77d4e58a0a72 tempest-VolumeImageDependencyTests-1691258063 None] Created volume successfully. Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Acquiring lock "cinder-645a34c2-db4d-483b-aa98-a05f9d13b572-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "cinder-645a34c2-db4d-483b-aa98-a05f9d13b572-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Acquiring lock "cinder-quobyte-645a34c2-db4d-483b-aa98-a05f9d13b572" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "cinder-quobyte-645a34c2-db4d-483b-aa98-a05f9d13b572" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ce586-e2d4-47fc-9990-ff34da364a8f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:51 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 Jul 21 19:22:51 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:52 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:52 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572 Jul 21 19:22:52 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:52 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-645a34c2-db4d-483b-aa98-a05f9d13b572" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "cinder-quobyte-645a34c2-db4d-483b-aa98-a05f9d13b572" released by "delete_volume" :: held 0.680s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Created reservations ['72dfef4d-76fb-4049-8a30-b3013bcb7f70', '6c865afa-423c-49da-8939-d194df0e671a', 'b9ebb6fd-5552-44f6-a832-712a9cd2f139', '70c9a661-c93a-4119-a312-0c137b565d4b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:52 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:22:52 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:52 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:22:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Deleted volume successfully. Jul 21 19:22:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f3e3d0c-6d8c-4e75-a850-965e6962c1ec tempest-VolumeImageDependencyTests-1691258063 None] Lock "cinder-645a34c2-db4d-483b-aa98-a05f9d13b572-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Flow 'volume_create_manager' (6dd85ed9-0e8d-4f11-903e-d97391e0fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24db4142-77e3-4759-b380-a3e93bb97647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24db4142-77e3-4759-b380-a3e93bb97647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12796482-4d16-4df1-9cfd-2f8c43912c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b34fd2f0d7493abedad65c638b28b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:56Z,use_quota=True,user_id='70987e72faf94c9694cb074b9e262518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e51bd-f2b8-4644-af77-7022bcdd291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542e51bd-f2b8-4644-af77-7022bcdd291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708fd2f9-4469-4ce7-973f-4d4d178de71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708fd2f9-4469-4ce7-973f-4d4d178de71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12796482-4d16-4df1-9cfd-2f8c43912c8e', 'volume_name': 'volume-12796482-4d16-4df1-9cfd-2f8c43912c8e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5696b-020a-4a22-af7b-c256da62d541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e5696b-020a-4a22-af7b-c256da62d541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937dc261-6041-4741-9c98-5a4c03675b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Volume 12796482-4d16-4df1-9cfd-2f8c43912c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12796482-4d16-4df1-9cfd-2f8c43912c8e', 'volume_size': 1} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12796482-4d16-4df1-9cfd-2f8c43912c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b34fd2f0d7493abedad65c638b28b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:56Z,use_quota=True,user_id='70987e72faf94c9694cb074b9e262518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Creating volume 12796482-4d16-4df1-9cfd-2f8c43912c8e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:56 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e 1073741824 Jul 21 19:22:56 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:56 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e 1073741824" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:56 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e Jul 21 19:22:56 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:56 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937dc261-6041-4741-9c98-5a4c03675b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12796482-4d16-4df1-9cfd-2f8c43912c8e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af9b320-b776-463e-ac5f-52427bc6773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Volume volume-12796482-4d16-4df1-9cfd-2f8c43912c8e (12796482-4d16-4df1-9cfd-2f8c43912c8e): created successfully Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af9b320-b776-463e-ac5f-52427bc6773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Flow 'volume_create_manager' (6dd85ed9-0e8d-4f11-903e-d97391e0fe57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dd70288c-3e76-4167-b746-66022bd03969 tempest-CinderUnicodeTest-1429935678 None] Created volume successfully. Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Flow 'volume_create_manager' (942abaf4-b55c-4ae5-a666-7d84c3fd24e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70168107-a0b6-40ea-a373-6f5d18e040d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70168107-a0b6-40ea-a373-6f5d18e040d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1160842450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e088f2c9-21d2-43ff-b50b-ed4ba7e594dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b34fd2f0d7493abedad65c638b28b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:57Z,use_quota=True,user_id='70987e72faf94c9694cb074b9e262518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187b021f-0daa-40df-9107-b98a39c03ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187b021f-0daa-40df-9107-b98a39c03ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ee7d4f-d79b-461e-af8a-2f0469363497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ee7d4f-d79b-461e-af8a-2f0469363497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e088f2c9-21d2-43ff-b50b-ed4ba7e594dd', 'volume_name': 'volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071af843-0174-4cdd-a650-12164d7b1f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071af843-0174-4cdd-a650-12164d7b1f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9db57-9d91-40ba-aada-00efcb0a716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Volume e088f2c9-21d2-43ff-b50b-ed4ba7e594dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd', 'volume_size': 1} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:22:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1160842450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e088f2c9-21d2-43ff-b50b-ed4ba7e594dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b34fd2f0d7493abedad65c638b28b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:22:57Z,use_quota=True,user_id='70987e72faf94c9694cb074b9e262518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Creating volume e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:22:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:57 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd 1073741824 Jul 21 19:22:57 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:57 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd 1073741824" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:57 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd Jul 21 19:22:57 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:58 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9db57-9d91-40ba-aada-00efcb0a716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715bc94-7ff8-4947-b424-8a93971d6203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:22:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Volume volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd (e088f2c9-21d2-43ff-b50b-ed4ba7e594dd): created successfully Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4715bc94-7ff8-4947-b424-8a93971d6203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Flow 'volume_create_manager' (942abaf4-b55c-4ae5-a666-7d84c3fd24e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:22:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-138c5e88-fae0-4788-bb48-2e2e33309a9c tempest-CinderUnicodeTest-1429935678 None] Created volume successfully. Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Creating offline snapshot d9202e6b-f5d2-42a5-b839-c276b9f38e81 of volume e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c44c102-c657-409a-a0c8-3a80e92b0c13]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:22:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:58 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd Jul 21 19:22:58 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:59 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:59 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 1G Jul 21 19:22:59 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:59 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 1G" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:59 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 Jul 21 19:22:59 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:22:59 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:22:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 is being set with open permissions: ugo+rw Jul 21 19:22:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:22:59 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 Jul 21 19:22:59 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:00 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:00 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info Jul 21 19:23:00 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:00 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info is being set with open permissions: ugo+rw Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:00 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info Jul 21 19:23:00 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:00 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e59f751b-d8b4-4fd0-a479-0e92c854419f tempest-CinderUnicodeTest-1429935678 None] Create snapshot completed successfully Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-d9202e6b-f5d2-42a5-b839-c276b9f38e81-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-d9202e6b-f5d2-42a5-b839-c276b9f38e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-quobyte-d9202e6b-f5d2-42a5-b839-c276b9f38e81" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-d9202e6b-f5d2-42a5-b839-c276b9f38e81" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Deleting offline snapshot d9202e6b-f5d2-42a5-b839-c276b9f38e81 of volume e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] snapshot_file for this snap is: volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[15522635-41c8-4562-8a1c-b62a403c2416]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:02 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 Jul 21 19:23:02 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:02 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74123f4d-2453-48b6-b43e-e18f4f2e6e3e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:02 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd Jul 21 19:23:02 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:02 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:02 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 Jul 21 19:23:02 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:03 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:03 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81 Jul 21 19:23:03 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:03 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd.d9202e6b-f5d2-42a5-b839-c276b9f38e81" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-d9202e6b-f5d2-42a5-b839-c276b9f38e81" released by "_delete_snapshot" :: held 1.436s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" released by "delete_snapshot" :: held 1.467s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Created reservations ['8cc5f93e-e4e1-4279-96da-2568d10e9a59', '77263406-b3a1-473d-8118-a8beb94ed97c', '19b203f3-9ba5-458b-ba32-71c4afdcaaef', '9e992c7d-5f8c-44ca-8b74-ecf85b2c8c36'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Delete snapshot completed successfully. Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-43b70ce1-9daf-4332-ac19-82f6a2224cfb tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-d9202e6b-f5d2-42a5-b839-c276b9f38e81-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[acebdc7c-30bf-4285-be5b-808628ed6a6f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:04 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd Jul 21 19:23:04 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:04 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:04 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd Jul 21 19:23:04 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:04 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd" released by "delete_volume" :: held 0.680s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Created reservations ['9c65c06c-f85e-45c2-bc2f-8f322df5099f', '66d39879-df12-44ce-8deb-87e6d31b69c7', '19db9453-41d5-4503-b08a-e649e0ef0b3f', 'ed7e8566-40f0-465e-a9b9-a4ce358fab4b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:04 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:04 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-12796482-4d16-4df1-9cfd-2f8c43912c8e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-12796482-4d16-4df1-9cfd-2f8c43912c8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:05 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Deleted volume successfully. Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "cinder-quobyte-12796482-4d16-4df1-9cfd-2f8c43912c8e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84f43e3e-2c54-4df0-9953-c66521ad04ef tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-e088f2c9-21d2-43ff-b50b-ed4ba7e594dd-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-12796482-4d16-4df1-9cfd-2f8c43912c8e" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ad317-89fd-43e1-a1b0-3099d2f2c643]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:05 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e Jul 21 19:23:05 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:05 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:05 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e Jul 21 19:23:05 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:05 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-12796482-4d16-4df1-9cfd-2f8c43912c8e" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-quobyte-12796482-4d16-4df1-9cfd-2f8c43912c8e" released by "delete_volume" :: held 0.697s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Created reservations ['d40bf5ee-214c-4b87-b1a7-b7cda6ed2e41', '001c5099-f108-48d7-9ed7-fec69ab3c824', '567b196f-7179-4bb9-9469-30176dda404d', '33713899-5bed-4e82-ac18-1966337f7bc4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:06 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:06 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:06 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Deleted volume successfully. Jul 21 19:23:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25caefdc-f517-44df-b23a-978e4f8a5754 tempest-CinderUnicodeTest-1429935678 None] Lock "cinder-12796482-4d16-4df1-9cfd-2f8c43912c8e-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Flow 'volume_create_manager' (6cb4ddb8-1afd-4bcf-be81-44914a777b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2fa245-f2d1-41d5-81f7-59e36fa52767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2fa245-f2d1-41d5-81f7-59e36fa52767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682242065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b5e78e-4b13-4ef1-bb21-7d056548ea96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e9296725649529e2b0ce4574eadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:10Z,use_quota=True,user_id='1eca7f917c3f494aad4b329b94a04b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d8ce37-42e7-4cba-8c4e-2144c9ba407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d8ce37-42e7-4cba-8c4e-2144c9ba407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f882f3-0515-4576-bf19-89c918c743d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f882f3-0515-4576-bf19-89c918c743d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b5e78e-4b13-4ef1-bb21-7d056548ea96', 'volume_name': 'volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfcddd5-f1f9-4a3f-b826-beeea7889689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfcddd5-f1f9-4a3f-b826-beeea7889689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55fee9-49f6-4c65-8158-30bcfe08e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Volume b5b5e78e-4b13-4ef1-bb21-7d056548ea96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96', 'volume_size': 1} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682242065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b5e78e-4b13-4ef1-bb21-7d056548ea96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e9296725649529e2b0ce4574eadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:10Z,use_quota=True,user_id='1eca7f917c3f494aad4b329b94a04b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Creating volume b5b5e78e-4b13-4ef1-bb21-7d056548ea96 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:10 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 1073741824 Jul 21 19:23:10 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:10 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 1073741824" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:10 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 Jul 21 19:23:10 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:10 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55fee9-49f6-4c65-8158-30bcfe08e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb76668-82c1-4212-99e4-b8c5089da341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Volume volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 (b5b5e78e-4b13-4ef1-bb21-7d056548ea96): created successfully Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb76668-82c1-4212-99e4-b8c5089da341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Flow 'volume_create_manager' (6cb4ddb8-1afd-4bcf-be81-44914a777b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc0fa827-d2c0-4e34-9528-e0471f975f8e tempest-ProjectReaderTests-916603873 None] Created volume successfully. Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Acquiring lock "cinder-b5b5e78e-4b13-4ef1-bb21-7d056548ea96-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "cinder-b5b5e78e-4b13-4ef1-bb21-7d056548ea96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Acquiring lock "cinder-quobyte-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "cinder-quobyte-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4b4f0-5d58-4586-99ac-220e7967883f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:12 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 Jul 21 19:23:12 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:12 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:12 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96 Jul 21 19:23:12 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:13 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "cinder-quobyte-b5b5e78e-4b13-4ef1-bb21-7d056548ea96" released by "delete_volume" :: held 0.767s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Created reservations ['790198ba-73fa-4cc0-a281-5272e0ed29be', '8cb80eed-d630-44aa-9447-0f84b2ee3e3e', 'e344be5a-90a4-4429-b59b-04acd172734a', '7d802b3c-82b9-420a-ac1a-09ce43407477'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:13 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:13 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:13 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Deleted volume successfully. Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c84d3796-7c41-4410-90c0-8c7ad6b4c300 tempest-ProjectReaderTests-916603873 None] Lock "cinder-b5b5e78e-4b13-4ef1-bb21-7d056548ea96-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Flow 'volume_create_manager' (59d45d34-83d3-459a-a914-cda169afbbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e5d9cb-a8e5-4e46-bfa7-b79d52b0dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e5d9cb-a8e5-4e46-bfa7-b79d52b0dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668168870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff96af8-3931-4342-bf85-b1e5f10c624b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e9296725649529e2b0ce4574eadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:14Z,use_quota=True,user_id='1eca7f917c3f494aad4b329b94a04b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31e64fd-78d6-4f48-b4f7-31cf8acaacb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31e64fd-78d6-4f48-b4f7-31cf8acaacb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884b4fd1-8b95-457c-9de0-795f08118e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884b4fd1-8b95-457c-9de0-795f08118e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff96af8-3931-4342-bf85-b1e5f10c624b', 'volume_name': 'volume-4ff96af8-3931-4342-bf85-b1e5f10c624b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9700fc2f-152d-40e1-a2a2-2ad325c66fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9700fc2f-152d-40e1-a2a2-2ad325c66fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376e07d8-dfbe-42de-b379-b1d045a00031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Volume 4ff96af8-3931-4342-bf85-b1e5f10c624b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff96af8-3931-4342-bf85-b1e5f10c624b', 'volume_size': 1} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668168870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff96af8-3931-4342-bf85-b1e5f10c624b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4e9296725649529e2b0ce4574eadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:14Z,use_quota=True,user_id='1eca7f917c3f494aad4b329b94a04b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Creating volume 4ff96af8-3931-4342-bf85-b1e5f10c624b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:13 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b 1073741824 Jul 21 19:23:13 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:14 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b 1073741824" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:14 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b Jul 21 19:23:14 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:14 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376e07d8-dfbe-42de-b379-b1d045a00031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff96af8-3931-4342-bf85-b1e5f10c624b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0d1ace-29c0-4212-865b-9e4fe05b96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Volume volume-4ff96af8-3931-4342-bf85-b1e5f10c624b (4ff96af8-3931-4342-bf85-b1e5f10c624b): created successfully Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f0d1ace-29c0-4212-865b-9e4fe05b96ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Flow 'volume_create_manager' (59d45d34-83d3-459a-a914-cda169afbbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09259a30-68c5-463b-8bf6-6f5d3f46d422 tempest-ProjectReaderTests-916603873 None] Created volume successfully. Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Flow 'volume_create_manager' (e803c771-0714-4c49-ab4e-881239a4b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8574c74-85d3-439a-9dc4-6d67ea79dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8574c74-85d3-439a-9dc4-6d67ea79dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1799113552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d945f1ea-7157-4028-847c-f0a1e34f1f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a5a33dd6494e2299fd43feb970f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:15Z,use_quota=True,user_id='e58b39c3d6a242aab1a39aa7f0eea652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe9a16f-2289-4a42-84ed-1cfbbabc654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe9a16f-2289-4a42-84ed-1cfbbabc654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4c12a2-abc2-45b4-b25a-6e9078a53970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4c12a2-abc2-45b4-b25a-6e9078a53970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd945f1ea-7157-4028-847c-f0a1e34f1f8d', 'volume_name': 'volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4912a7-f753-40c9-93d6-3fb7f9903c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4912a7-f753-40c9-93d6-3fb7f9903c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9155f545-e7ad-463a-bfa1-8979d33ca9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Volume d945f1ea-7157-4028-847c-f0a1e34f1f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d', 'volume_size': 1} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1799113552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d945f1ea-7157-4028-847c-f0a1e34f1f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a5a33dd6494e2299fd43feb970f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:15Z,use_quota=True,user_id='e58b39c3d6a242aab1a39aa7f0eea652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Creating volume d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:15 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d 1073741824 Jul 21 19:23:15 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:15 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d 1073741824" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Acquiring lock "cinder-4ff96af8-3931-4342-bf85-b1e5f10c624b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "cinder-4ff96af8-3931-4342-bf85-b1e5f10c624b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:16 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:16 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Acquiring lock "cinder-quobyte-4ff96af8-3931-4342-bf85-b1e5f10c624b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "cinder-quobyte-4ff96af8-3931-4342-bf85-b1e5f10c624b" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52990ce0-60e2-4672-af33-299001c133cb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:16 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b Jul 21 19:23:16 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:16 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9155f545-e7ad-463a-bfa1-8979d33ca9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24467a62-e622-4e27-b1f5-9a7f2e4b3b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Volume volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d (d945f1ea-7157-4028-847c-f0a1e34f1f8d): created successfully Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24467a62-e622-4e27-b1f5-9a7f2e4b3b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Flow 'volume_create_manager' (e803c771-0714-4c49-ab4e-881239a4b94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5bcd0673-b5f0-4b0e-9b05-06b1306b60ae tempest-SnapshotDependencyTests-577399808 None] Created volume successfully. Jul 21 19:23:16 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:16 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b Jul 21 19:23:16 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:16 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4ff96af8-3931-4342-bf85-b1e5f10c624b" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "cinder-quobyte-4ff96af8-3931-4342-bf85-b1e5f10c624b" released by "delete_volume" :: held 0.669s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Creating offline snapshot de1123c0-8107-4b14-b61e-44c5908320ed of volume d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9099f09-2d6a-4297-908e-2494b4b815d3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Created reservations ['7ec79a19-212f-4fb6-95ee-5d5f161d97c6', '72d06d15-a862-484c-8258-2daf031a6559', '25f785aa-f92a-4bf3-a649-edb775e0208c', '9704b66b-1594-4cef-ac49-4a59fc028f0a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:16 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:16 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:16 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:16 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:17 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:17 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Deleted volume successfully. Jul 21 19:23:17 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed 1G Jul 21 19:23:17 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b6ed555e-f8a5-4dbb-92b9-d37e64b3c4da tempest-ProjectReaderTests-916603873 None] Lock "cinder-4ff96af8-3931-4342-bf85-b1e5f10c624b-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:17 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed 1G" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:17 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:17 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:17 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed is being set with open permissions: ugo+rw Jul 21 19:23:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:17 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:17 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:18 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:18 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info Jul 21 19:23:18 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:18 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:18 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info is being set with open permissions: ugo+rw Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:18 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info Jul 21 19:23:18 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:18 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.info" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4fe36b4f-e2be-438b-87ee-c44732469ecb tempest-SnapshotDependencyTests-577399808 None] Create snapshot completed successfully Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Flow 'volume_create_manager' (a3b3df37-ab04-4c47-93df-b7b7de15c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51237b21-22f5-4379-bde6-89f90b549989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51237b21-22f5-4379-bde6-89f90b549989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b4d7c9-1ceb-452d-965e-bd28005878b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a5a33dd6494e2299fd43feb970f8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de1123c0-8107-4b14-b61e-44c5908320ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:20Z,use_quota=True,user_id='e58b39c3d6a242aab1a39aa7f0eea652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e29f60c-5fcc-4e0a-86ce-300fbf5dd580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e29f60c-5fcc-4e0a-86ce-300fbf5dd580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1812720b-a5ec-4667-94e1-a1fd4181de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1812720b-a5ec-4667-94e1-a1fd4181de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8b4d7c9-1ceb-452d-965e-bd28005878b3', 'volume_name': 'volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3', 'volume_size': 1, 'snapshot_id': 'de1123c0-8107-4b14-b61e-44c5908320ed'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caffbce7-9af0-4383-856b-2ed6e21152b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caffbce7-9af0-4383-856b-2ed6e21152b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33548f6-f8fb-4756-948b-33e3cd2c78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Volume d8b4d7c9-1ceb-452d-965e-bd28005878b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3', 'volume_size': 1, 'snapshot_id': 'de1123c0-8107-4b14-b61e-44c5908320ed'} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed-d8b4d7c9-1ceb-452d-965e-bd28005878b3" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed-d8b4d7c9-1ceb-452d-965e-bd28005878b3" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Creating volume d8b4d7c9-1ceb-452d-965e-bd28005878b3 from snapshot de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] snapshot: de1123c0-8107-4b14-b61e-44c5908320ed, volume: d8b4d7c9-1ceb-452d-965e-bd28005878b3, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5596fc-5f60-4f5f-803d-8fac65d728da]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:20 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:20 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:20 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f631e-63ec-47e3-b231-2c00a977a027]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:20 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:20 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:21 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:21 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:23:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:21 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 Jul 21 19:23:21 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:25 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3" returned: 0 in 3.996s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c345ad-cd00-4fc2-a4ed-83687a3b5192]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:25 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:25 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:25 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:23:25 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Converted 1024.00 MB image at 256.17 MB/s Jul 21 19:23:25 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 is being set with open permissions: ugo+rw Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:25 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 Jul 21 19:23:25 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:25 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:25 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:25 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" released by "_copy_volume_from_snapshot" :: held 5.510s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed-d8b4d7c9-1ceb-452d-965e-bd28005878b3" released by "_create_volume_from_snapshot" :: held 5.537s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.550s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:25 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:23:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33548f6-f8fb-4756-948b-33e3cd2c78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3', 'volume_size': 1, 'snapshot_id': 'de1123c0-8107-4b14-b61e-44c5908320ed'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac23b1d-6458-49b2-9167-e42b19f36bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Volume volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 (d8b4d7c9-1ceb-452d-965e-bd28005878b3): created successfully Jul 21 19:23:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac23b1d-6458-49b2-9167-e42b19f36bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Flow 'volume_create_manager' (a3b3df37-ab04-4c47-93df-b7b7de15c924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2912f48d-9fef-4090-bf0b-a1009951d5e5 tempest-SnapshotDependencyTests-577399808 None] Created volume successfully. Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-de1123c0-8107-4b14-b61e-44c5908320ed-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-de1123c0-8107-4b14-b61e-44c5908320ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Deleting offline snapshot de1123c0-8107-4b14-b61e-44c5908320ed of volume d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] snapshot_file for this snap is: volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6070b586-5fc8-40eb-a925-0852360ba6a5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:27 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:27 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:27 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab7e41-3c8e-476c-9ffd-cb0b8228c9f6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:27 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:27 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:27 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:27 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:27 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:28 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:28 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed Jul 21 19:23:28 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:28 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d.de1123c0-8107-4b14-b61e-44c5908320ed" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-de1123c0-8107-4b14-b61e-44c5908320ed" released by "_delete_snapshot" :: held 1.330s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" released by "delete_snapshot" :: held 1.352s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Created reservations ['8544ce91-e524-4bbd-8e3f-0ed9add68750', 'ce71699a-53c4-4e17-9872-a365ee497787', '04300cba-9729-4417-9c83-4f0a8750622a', '18178118-ba59-4594-8212-7251cb18e1db'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Delete snapshot completed successfully. Jul 21 19:23:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ffa7854-7ed8-4d2e-8abc-76d5862b5419 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-de1123c0-8107-4b14-b61e-44c5908320ed-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-d945f1ea-7157-4028-847c-f0a1e34f1f8d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-d945f1ea-7157-4028-847c-f0a1e34f1f8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab3d6c-fab5-40e7-9ee6-f700fba252bb]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:29 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:29 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:29 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:29 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d Jul 21 19:23:29 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:29 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d945f1ea-7157-4028-847c-f0a1e34f1f8d" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d945f1ea-7157-4028-847c-f0a1e34f1f8d" released by "delete_volume" :: held 0.610s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Created reservations ['11a2c869-d374-4512-9b88-894a2380fe0c', '6162f8cc-9a77-4065-9ae7-ddb36af64e10', 'c70e9e1c-7d74-4060-825c-e053cf7ba625', 'ec4f5209-da31-4ab0-85fe-81894af73043'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:30 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:30 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:30 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Deleted volume successfully. Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-38a72e48-acf2-4230-8ebc-edaa110f46f7 tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-d945f1ea-7157-4028-847c-f0a1e34f1f8d-delete_volume" released by "delete_volume" :: held 1.028s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-d8b4d7c9-1ceb-452d-965e-bd28005878b3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-d8b4d7c9-1ceb-452d-965e-bd28005878b3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2291a3-0285-4676-9e65-73e07eb9bc8a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:30 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 Jul 21 19:23:30 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:30 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:30 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3 Jul 21 19:23:30 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:31 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-d8b4d7c9-1ceb-452d-965e-bd28005878b3" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-quobyte-d8b4d7c9-1ceb-452d-965e-bd28005878b3" released by "delete_volume" :: held 0.628s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Created reservations ['9e86e410-15a8-4649-bcba-44d0c07a8704', '59ef6f5a-d987-4e94-ac95-0d7a05b374a6', 'a50a880e-1c9c-4407-8378-ce690771c52a', 'd2ab63cf-ce37-482a-b26a-773bde5f0339'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:31 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:23:31 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:31 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:23:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Deleted volume successfully. Jul 21 19:23:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81f37391-d2c4-413e-a10a-2bc4e442b02a tempest-SnapshotDependencyTests-577399808 None] Lock "cinder-d8b4d7c9-1ceb-452d-965e-bd28005878b3-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:23:41 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=86,cinder:INSERT=31,cinder:UPDATE=120,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:23:41 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=108,cinder:DELETE=12,cinder:SELECT=91,cinder:INSERT=34 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Flow 'volume_create_manager' (6f459b8b-972b-49b2-b935-02a008a665c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215a0633-6ee6-4b7b-ae1f-cfd1db08df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215a0633-6ee6-4b7b-ae1f-cfd1db08df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-812285789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0142e61e-c7fa-4491-9515-64261994f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ec75dbdf4471bb246b016eb4ee28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='eb9243f3f9934c0da5ac0759450c319c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b603309-f4d7-4f73-952e-2cc2430d2ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b603309-f4d7-4f73-952e-2cc2430d2ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b55af8-9c95-4a76-85d7-e51d658ea105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b55af8-9c95-4a76-85d7-e51d658ea105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0142e61e-c7fa-4491-9515-64261994f93f', 'volume_name': 'volume-0142e61e-c7fa-4491-9515-64261994f93f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a7f757-299e-4de6-9c44-c5e4c9e8528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a7f757-299e-4de6-9c44-c5e4c9e8528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8959c5dc-1e2a-4044-814a-dc99981f2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Volume 0142e61e-c7fa-4491-9515-64261994f93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0142e61e-c7fa-4491-9515-64261994f93f', 'volume_size': 1} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-812285789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0142e61e-c7fa-4491-9515-64261994f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ec75dbdf4471bb246b016eb4ee28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='eb9243f3f9934c0da5ac0759450c319c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Creating volume 0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:50 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f 1073741824 Jul 21 19:23:50 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (737025ba-9e87-42e6-8260-2343311f7367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8879c03a-22f1-44e1-bfa0-25833877fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8879c03a-22f1-44e1-bfa0-25833877fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591977661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61dce40-499b-4fb6-a2e0-76b48dd13e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1aaaae-5a33-48dd-a677-d3b87e384b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1aaaae-5a33-48dd-a677-d3b87e384b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202b5581-c6fe-4d5e-8df9-3f827fb50a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202b5581-c6fe-4d5e-8df9-3f827fb50a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61dce40-499b-4fb6-a2e0-76b48dd13e06', 'volume_name': 'volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48de654d-36fe-4dea-a9fc-1bd50ae19d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48de654d-36fe-4dea-a9fc-1bd50ae19d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47baf7c3-31bd-4f9c-802a-5b8f801c0e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume c61dce40-499b-4fb6-a2e0-76b48dd13e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06', 'volume_size': 1} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (54c26b06-06f3-455e-9046-2d61d80a0b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f629ea-1511-43fa-b0b8-9c1c023d4c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f629ea-1511-43fa-b0b8-9c1c023d4c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21132486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968cd457-90de-4c71-876b-615f15b93aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d11d897-4d47-4220-bdf0-5028b5dfdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d11d897-4d47-4220-bdf0-5028b5dfdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6ee798-e8db-4716-bffb-813f2d4339da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6ee798-e8db-4716-bffb-813f2d4339da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968cd457-90de-4c71-876b-615f15b93aac', 'volume_name': 'volume-968cd457-90de-4c71-876b-615f15b93aac', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d6586-aa0c-4032-8f18-7d6b752f1a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161d6586-aa0c-4032-8f18-7d6b752f1a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fb6610-2d2b-444a-be39-4fb3e2aab56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume 968cd457-90de-4c71-876b-615f15b93aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968cd457-90de-4c71-876b-615f15b93aac', 'volume_size': 1} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:50 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f 1073741824" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:50 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:23:50 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:50 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1591977661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61dce40-499b-4fb6-a2e0-76b48dd13e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume c61dce40-499b-4fb6-a2e0-76b48dd13e06 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8959c5dc-1e2a-4044-814a-dc99981f2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0142e61e-c7fa-4491-9515-64261994f93f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729ca023-77c7-4ae7-8205-073a19807557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:50 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 1073741824 Jul 21 19:23:51 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Volume volume-0142e61e-c7fa-4491-9515-64261994f93f (0142e61e-c7fa-4491-9515-64261994f93f): created successfully Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729ca023-77c7-4ae7-8205-073a19807557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Flow 'volume_create_manager' (6f459b8b-972b-49b2-b935-02a008a665c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-26ec963d-035a-4d5a-b652-53e78f47a216 tempest-VolumeDependencyTests-1032809606 None] Created volume successfully. Jul 21 19:23:51 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 1073741824" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:51 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 Jul 21 19:23:51 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:51 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21132486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968cd457-90de-4c71-876b-615f15b93aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:50Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume 968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:51 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac 1073741824 Jul 21 19:23:51 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47baf7c3-31bd-4f9c-802a-5b8f801c0e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd2a8e4-801c-4ac9-93fe-139d2bb9eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 (c61dce40-499b-4fb6-a2e0-76b48dd13e06): created successfully Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd2a8e4-801c-4ac9-93fe-139d2bb9eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (737025ba-9e87-42e6-8260-2343311f7367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aa95b760-f1d7-45fd-ae14-b5c3980576c4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:52 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac 1073741824" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:52 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac Jul 21 19:23:52 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:52 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.461s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Creating offline snapshot 68b66ccb-9003-47dc-8ca2-7eb632cb2b80 of volume 0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fb6610-2d2b-444a-be39-4fb3e2aab56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968cd457-90de-4c71-876b-615f15b93aac', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc222f89-b59e-43ed-b5b3-83cf1e30f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e708126-ecd5-4158-9627-89802ddb650e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (8ad8e79b-90c0-44cb-b259-8f0d39bfda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c70355-8ca5-4358-a611-0ec7ce0c74d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-968cd457-90de-4c71-876b-615f15b93aac (968cd457-90de-4c71-876b-615f15b93aac): created successfully Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc222f89-b59e-43ed-b5b3-83cf1e30f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (54c26b06-06f3-455e-9046-2d61d80a0b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c70355-8ca5-4358-a611-0ec7ce0c74d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356908198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9362aa76-9155-47fc-b061-10b333d9821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:53Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60770e76-cf1d-4069-8873-c7c89763a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60770e76-cf1d-4069-8873-c7c89763a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd83a82-84b4-4d0f-b077-d70b32c905e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd83a82-84b4-4d0f-b077-d70b32c905e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9362aa76-9155-47fc-b061-10b333d9821a', 'volume_name': 'volume-9362aa76-9155-47fc-b061-10b333d9821a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b9515-6ad2-4210-8bfc-a564bccc04a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:23:52 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b9515-6ad2-4210-8bfc-a564bccc04a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a63f6c1-0d03-44e1-8d6f-103b335dde51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume 9362aa76-9155-47fc-b061-10b333d9821a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9362aa76-9155-47fc-b061-10b333d9821a', 'volume_size': 1} Jul 21 19:23:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-afd44888-2fb1-4c07-9cd4-e1a5f2b00ede tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (78ac02a0-7cb4-4d78-bc81-76984e2e1785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e2ffbd-c3b5-44a7-a157-0e7c0506023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e2ffbd-c3b5-44a7-a157-0e7c0506023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514498765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a119d-ec37-484c-8e2e-60028dfe9405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:53Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30948e2e-498f-4c35-96e5-f648e0b05225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 1G Jul 21 19:23:53 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30948e2e-498f-4c35-96e5-f648e0b05225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a976e6d3-b19a-4300-8f9b-f58696c04d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a976e6d3-b19a-4300-8f9b-f58696c04d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0a119d-ec37-484c-8e2e-60028dfe9405', 'volume_name': 'volume-dc0a119d-ec37-484c-8e2e-60028dfe9405', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24043056-99d3-4f55-a7c6-3cea31d81c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24043056-99d3-4f55-a7c6-3cea31d81c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632324f2-546b-442b-9dcb-1bf63c065f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume dc0a119d-ec37-484c-8e2e-60028dfe9405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0a119d-ec37-484c-8e2e-60028dfe9405', 'volume_size': 1} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (d5a037c7-b9a3-49a4-891f-4d969b9ba423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffa6f22-64f7-41a4-b27a-f2ae84df2bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffa6f22-64f7-41a4-b27a-f2ae84df2bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648249325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5b5854-6cda-465d-943f-acf520fc2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5b5854-6cda-465d-943f-acf520fc2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e10264-ecc6-4982-8e0c-7184a8bcb641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e10264-ecc6-4982-8e0c-7184a8bcb641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc', 'volume_name': 'volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319739a1-e812-4aee-bc5f-036e9964cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319739a1-e812-4aee-bc5f-036e9964cae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b031c49e-1641-44a1-8751-eca954341ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc', 'volume_size': 1} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:53 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 1G" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0142e61e-c7fa-4491-9515-64261994f93f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:53 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0142e61e-c7fa-4491-9515-64261994f93f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:23:53 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:54 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0142e61e-c7fa-4491-9515-64261994f93f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 is being set with open permissions: ugo+rw Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (147c910b-5b93-42d9-a6cf-3077b69f3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b23421-f1a7-4d6f-9acc-e057093cddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:23:54 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b23421-f1a7-4d6f-9acc-e057093cddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652050978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330ef33-1d15-4b33-af2b-d2d8a9281a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e42d049-54d9-40c6-8cb4-aa7fd97efe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e42d049-54d9-40c6-8cb4-aa7fd97efe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb8305-5d33-42e1-9632-17272689fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb8305-5d33-42e1-9632-17272689fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4330ef33-1d15-4b33-af2b-d2d8a9281a07', 'volume_name': 'volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc579f1-82a9-4b90-ad18-6e00211b2f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc579f1-82a9-4b90-ad18-6e00211b2f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e15a0-913a-49cd-9ad0-1607be8d4210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume 4330ef33-1d15-4b33-af2b-d2d8a9281a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07', 'volume_size': 1} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:54 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Flow 'volume_create_manager' (957fb83c-d03f-4f9a-ac20-1d56e4403f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079eecc-3e59-44fe-b757-2f39036bb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079eecc-3e59-44fe-b757-2f39036bb21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c1dd6c-6aa5-40e2-b256-b89c60ed651f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8356ca40881646528ae476fba99bb73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='2986cd541db9492c86db1e505d602ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984f781a-2493-48cc-a487-85dd938897a7),volume_type_id=984f781a-2493-48cc-a487-85dd938897a7)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd44b687-f5c3-4e4c-aca1-5af0f7444584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd44b687-f5c3-4e4c-aca1-5af0f7444584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89689c5-51b4-449a-ac85-fbb384533a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:54 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info Jul 21 19:23:54 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (61900370-0886-4d01-b791-a715bcb28488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cbeac6-61f6-43b6-b023-4e0cdd618318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cbeac6-61f6-43b6-b023-4e0cdd618318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953153332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914d7c92-d6ea-47d7-98fc-06ad9a7a26fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:55Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110dfd99-5438-48bd-be39-d5d66a3029b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110dfd99-5438-48bd-be39-d5d66a3029b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9b41d5-a990-4c4e-8bd8-86da23a1bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9b41d5-a990-4c4e-8bd8-86da23a1bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914d7c92-d6ea-47d7-98fc-06ad9a7a26fc', 'volume_name': 'volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2d735-0ebc-4412-a81a-b4c85276bbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2d735-0ebc-4412-a81a-b4c85276bbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0418acbe-8a1d-48d6-b34d-6d7fc2d84c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume 914d7c92-d6ea-47d7-98fc-06ad9a7a26fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc', 'volume_size': 1} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89689c5-51b4-449a-ac85-fbb384533a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00c1dd6c-6aa5-40e2-b256-b89c60ed651f', 'volume_name': 'volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f', 'volume_size': 1, 'image_id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ac6d9396d20d4545cdd64ab85934f22a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8356ca40881646528ae476fba99bb73e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7be12cf01a494f608a03a153b85907b4239600cb642c1a7a2176ccb1d7de207c848bf1ace5252ada35f68d51043db2a0519eb7b395b645f67dd13c2b124a808c', 'id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'created_at': datetime.datetime(2026, 7, 21, 17, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5fd406-d433-4e97-9131-666b49a85ceb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d7d390-3957-4202-a354-21dea32445ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d7d390-3957-4202-a354-21dea32445ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5436c4ac-f711-4c64-a377-37c545a17d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f', 'volume_size': 1, 'image_id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ac6d9396d20d4545cdd64ab85934f22a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8356ca40881646528ae476fba99bb73e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7be12cf01a494f608a03a153b85907b4239600cb642c1a7a2176ccb1d7de207c848bf1ace5252ada35f68d51043db2a0519eb7b395b645f67dd13c2b124a808c', 'id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'created_at': datetime.datetime(2026, 7, 21, 17, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5fd406-d433-4e97-9131-666b49a85ceb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Trying to clone 00c1dd6c-6aa5-40e2-b256-b89c60ed651f from image db5fd406-d433-4e97-9131-666b49a85ceb at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:23:54 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info is being set with open permissions: ugo+rw Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:54 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info Jul 21 19:23:54 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:23:54 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e15f8b4-9886-4339-80be-c8115fd0c3d5]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:23:55 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.info" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356908198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9362aa76-9155-47fc-b061-10b333d9821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:53Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume 9362aa76-9155-47fc-b061-10b333d9821a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a 1073741824 Jul 21 19:23:55 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-049d26bd-69ff-4027-9a1f-611aaaae8751 tempest-VolumeDependencyTests-1032809606 None] Create snapshot completed successfully Jul 21 19:23:55 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:23:55 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a 1073741824" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a Jul 21 19:23:55 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Temporary image db5fd406-d433-4e97-9131-666b49a85ceb is fetched for user 2986cd541db9492c86db1e505d602ff7. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f03ae-dab7-4068-b26e-0440154638cb]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:23:55 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1514498765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a119d-ec37-484c-8e2e-60028dfe9405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:53Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume dc0a119d-ec37-484c-8e2e-60028dfe9405 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a63f6c1-0d03-44e1-8d6f-103b335dde51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9362aa76-9155-47fc-b061-10b333d9821a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ec00ff-c453-4276-b617-b8f99aac31df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:55 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 1073741824 Jul 21 19:23:55 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-9362aa76-9155-47fc-b061-10b333d9821a (9362aa76-9155-47fc-b061-10b333d9821a): created successfully Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ec00ff-c453-4276-b617-b8f99aac31df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (8ad8e79b-90c0-44cb-b259-8f0d39bfda00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7f435867-4384-4090-9789-200a0a8f6561 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Flow 'volume_create_manager' (80532918-3f64-4e62-810b-29e9b9af7904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df382abb-c82f-4624-a753-34d76b3bfea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df382abb-c82f-4624-a753-34d76b3bfea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1947711079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df25c977-b945-4a07-8b92-7d7b5b518770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ec75dbdf4471bb246b016eb4ee28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68b66ccb-9003-47dc-8ca2-7eb632cb2b80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:56Z,use_quota=True,user_id='eb9243f3f9934c0da5ac0759450c319c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd166ea2-983f-4f86-b3cf-7b1071558eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd166ea2-983f-4f86-b3cf-7b1071558eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556aca07-a04b-4b68-a439-1b581749a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556aca07-a04b-4b68-a439-1b581749a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df25c977-b945-4a07-8b92-7d7b5b518770', 'volume_name': 'volume-df25c977-b945-4a07-8b92-7d7b5b518770', 'volume_size': 1, 'snapshot_id': '68b66ccb-9003-47dc-8ca2-7eb632cb2b80'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a97301c-2015-420c-a661-73df7c483f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a97301c-2015-420c-a661-73df7c483f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9c9de1-5a4f-41c2-b175-d16781f1089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Volume df25c977-b945-4a07-8b92-7d7b5b518770: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df25c977-b945-4a07-8b92-7d7b5b518770', 'volume_size': 1, 'snapshot_id': '68b66ccb-9003-47dc-8ca2-7eb632cb2b80'} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:56 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:23:56 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:56 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 1073741824" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:56 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 Jul 21 19:23:56 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:56 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:56 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648249325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:56 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc 1073741824 Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632324f2-546b-442b-9dcb-1bf63c065f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0a119d-ec37-484c-8e2e-60028dfe9405', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d5980b-fed9-486b-891b-5a0bf04edb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 (dc0a119d-ec37-484c-8e2e-60028dfe9405): created successfully Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d5980b-fed9-486b-891b-5a0bf04edb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (78ac02a0-7cb4-4d78-bc81-76984e2e1785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-beef6666-b9a3-4235-91cf-aeaaa85122e9 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:23:57 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc 1073741824" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:57 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc Jul 21 19:23:57 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:57 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.119s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652050978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330ef33-1d15-4b33-af2b-d2d8a9281a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume 4330ef33-1d15-4b33-af2b-d2d8a9281a07 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:23:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b031c49e-1641-44a1-8751-eca954341ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:57 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 1073741824 Jul 21 19:23:57 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d11eac-25c5-4a60-b842-52283203b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc (aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc): created successfully Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d11eac-25c5-4a60-b842-52283203b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (d5a037c7-b9a3-49a4-891f-4d969b9ba423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a1b0f077-7ad7-492a-845d-73b13b13f398 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:23:57 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 1073741824" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:57 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 Jul 21 19:23:57 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:58 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.630s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e15a0-913a-49cd-9ad0-1607be8d4210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb48c693-812e-441e-87b5-e6743c3dcf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating offline snapshot 27993ecd-9703-49cf-8c20-2b3cea0b16ed of volume 968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:23:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 (4330ef33-1d15-4b33-af2b-d2d8a9281a07): created successfully Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb48c693-812e-441e-87b5-e6743c3dcf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (147c910b-5b93-42d9-a6cf-3077b69f3fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16564b1-89e8-4b2e-897d-ddb934344621]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-485141f5-ab1e-456c-bc22-da9a34c9bedc tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:23:58 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac Jul 21 19:23:58 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:58 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:58 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed 1G Jul 21 19:23:58 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:59 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed 1G" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968cd457-90de-4c71-876b-615f15b93aac -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:59 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968cd457-90de-4c71-876b-615f15b93aac -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed Jul 21 19:23:59 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:59 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968cd457-90de-4c71-876b-615f15b93aac -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed is being set with open permissions: ugo+rw Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:59 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed Jul 21 19:23:59 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:59 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:59 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info Jul 21 19:23:59 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:23:59 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:23:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info is being set with open permissions: ugo+rw Jul 21 19:23:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:23:59 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info Jul 21 19:23:59 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:00 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.314s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953153332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914d7c92-d6ea-47d7-98fc-06ad9a7a26fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0294e033386646f79be4f573b56e5ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:55Z,use_quota=True,user_id='28e99f6dbcc149a2a3ca3cc332d9d76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Creating volume 914d7c92-d6ea-47d7-98fc-06ad9a7a26fc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:00 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc 1073741824 Jul 21 19:24:00 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-980207b6-c3f9-49ab-a519-28deda437e1c tempest-CreateVolumesFromSnapshotTest-198052231 None] Create snapshot completed successfully Jul 21 19:24:00 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc 1073741824" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:00 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc Jul 21 19:24:00 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:00 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.608s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-df25c977-b945-4a07-8b92-7d7b5b518770" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0418acbe-8a1d-48d6-b34d-6d7fc2d84c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9482d5-0759-4784-ab9d-da1931f5b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-df25c977-b945-4a07-8b92-7d7b5b518770" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Creating volume df25c977-b945-4a07-8b92-7d7b5b518770 from snapshot 68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Volume volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc (914d7c92-d6ea-47d7-98fc-06ad9a7a26fc): created successfully Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9482d5-0759-4784-ab9d-da1931f5b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Flow 'volume_create_manager' (61900370-0886-4d01-b791-a715bcb28488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] snapshot: 68b66ccb-9003-47dc-8ca2-7eb632cb2b80, volume: df25c977-b945-4a07-8b92-7d7b5b518770, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:24:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-53559985-5a88-456e-a95f-f1c3fb6cdd48 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created volume successfully. Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb408f88-9483-4a5b-86db-b9f6927e7d1a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (b7bef2b1-1b5b-4512-b83d-3cc6ae2cc28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:01 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:24:01 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eceb10-be05-49cf-b4a5-7f3db40f3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eceb10-be05-49cf-b4a5-7f3db40f3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975882674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe0487-d569-4661-b6b7-ba8843d661b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:01Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701a1e60-be4d-4b98-bca5-c48aa0c9d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701a1e60-be4d-4b98-bca5-c48aa0c9d84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f0a0a2-861b-4511-9cc7-a0dead470d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f0a0a2-861b-4511-9cc7-a0dead470d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbe0487-d569-4661-b6b7-ba8843d661b3', 'volume_name': 'volume-7fbe0487-d569-4661-b6b7-ba8843d661b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea544d13-b945-48a0-8139-dcddd1d403c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea544d13-b945-48a0-8139-dcddd1d403c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b978031d-4975-4dd2-80a9-87a2e8424262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume 7fbe0487-d569-4661-b6b7-ba8843d661b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbe0487-d569-4661-b6b7-ba8843d661b3', 'volume_size': 1} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cdfff1-ddb3-40ab-a494-3f84c1af7de3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:01 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc Jul 21 19:24:01 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:01 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0142e61e-c7fa-4491-9515-64261994f93f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6184f-d7cc-4966-a663-802796202435]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (ef9a2e2d-99bc-41a6-8844-a04eba2230e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c1e34a-d3aa-451f-931c-ba9901532d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c1e34a-d3aa-451f-931c-ba9901532d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958401088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e908636-98bc-4409-9211-3944418cb791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:01Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdc3f68-33cf-4def-aa52-c7ba3b93f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdc3f68-33cf-4def-aa52-c7ba3b93f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e257cb-fd76-477c-b013-9d9c0b79a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e257cb-fd76-477c-b013-9d9c0b79a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e908636-98bc-4409-9211-3944418cb791', 'volume_name': 'volume-9e908636-98bc-4409-9211-3944418cb791', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4891f84b-582a-4fa1-bedc-c55ac8297e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4891f84b-582a-4fa1-bedc-c55ac8297e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f743b147-1b48-417c-a47c-6770a4c91bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:24:01 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume 9e908636-98bc-4409-9211-3944418cb791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e908636-98bc-4409-9211-3944418cb791', 'volume_size': 1} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:01 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" returned: 0 in 0.491s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:01 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc Jul 21 19:24:01 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (ea497de6-3c25-4a04-b17c-21688131fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0daa2496-c714-4f9e-8b87-e1c8700a6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:01 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.487s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:24:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0daa2496-c714-4f9e-8b87-e1c8700a6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253984552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e916c6-0de4-4533-a5b0-febf4805318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:02Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b069c30c-9d8e-41d6-8829-d5f3a7d79252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b069c30c-9d8e-41d6-8829-d5f3a7d79252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2510470b-7dc5-4119-a719-fa65a2628937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 Jul 21 19:24:02 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2510470b-7dc5-4119-a719-fa65a2628937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e916c6-0de4-4533-a5b0-febf4805318a', 'volume_name': 'volume-80e916c6-0de4-4533-a5b0-febf4805318a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0e3b7e-923d-4d16-ad59-5e764825301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0e3b7e-923d-4d16-ad59-5e764825301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d41e83-6030-4618-9b4c-11d13198e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume 80e916c6-0de4-4533-a5b0-febf4805318a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e916c6-0de4-4533-a5b0-febf4805318a', 'volume_size': 1} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:02 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc" released by "delete_volume" :: held 0.875s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['1d281af6-78cb-432d-a1af-805af793a09d', '2de834cf-5378-4c3f-8398-20a37aeee0d7', '927643e0-5c2c-4b8a-bf94-395c5f727acc', 'a232834f-95a1-482a-954f-3c92c18650b3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:02 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:02 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (e184e212-0114-4a34-8b03-e82faedfd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ccbd83-0d69-47d8-91a2-ee7b45c96623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ccbd83-0d69-47d8-91a2-ee7b45c96623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983655075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b5daec-c3ca-4711-b6d3-b199868c5a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:02Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a6c27c-e88a-472e-a4e1-7389cd41b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a6c27c-e88a-472e-a4e1-7389cd41b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1c8530-c64d-4cdf-8b83-fe6069bd00a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1c8530-c64d-4cdf-8b83-fe6069bd00a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b5daec-c3ca-4711-b6d3-b199868c5a80', 'volume_name': 'volume-11b5daec-c3ca-4711-b6d3-b199868c5a80', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3e41fb-9ae3-460a-a759-3946261a544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3e41fb-9ae3-460a-a759-3946261a544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba8e80c-b545-402d-9aa7-4fc78c49bb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume 11b5daec-c3ca-4711-b6d3-b199868c5a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b5daec-c3ca-4711-b6d3-b199868c5a80', 'volume_size': 1} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:02 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bd5a76d2-f815-496f-835c-04b27bee2421 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-914d7c92-d6ea-47d7-98fc-06ad9a7a26fc-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (12b18bc9-20e7-484c-af83-25e3e7ddc46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824fb01b-826c-42ef-8381-03a94b8f368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824fb01b-826c-42ef-8381-03a94b8f368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713926427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5297e69-01c1-4c7f-8722-fbe196f448b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:03Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4255335e-c0d0-4e7c-a15c-2866b989a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4255335e-c0d0-4e7c-a15c-2866b989a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9169716d-29a2-41da-85bf-cd9f1867d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9169716d-29a2-41da-85bf-cd9f1867d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5297e69-01c1-4c7f-8722-fbe196f448b6', 'volume_name': 'volume-a5297e69-01c1-4c7f-8722-fbe196f448b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8babfbdf-dadf-40ea-b72a-c8948e730fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8babfbdf-dadf-40ea-b72a-c8948e730fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fbb58-94b3-4d59-a809-f085e03b3be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume a5297e69-01c1-4c7f-8722-fbe196f448b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5297e69-01c1-4c7f-8722-fbe196f448b6', 'volume_size': 1} Jul 21 19:24:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-4330ef33-1d15-4b33-af2b-d2d8a9281a07-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-4330ef33-1d15-4b33-af2b-d2d8a9281a07-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-4330ef33-1d15-4b33-af2b-d2d8a9281a07" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-4330ef33-1d15-4b33-af2b-d2d8a9281a07" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060ea69-eeb6-4c32-996e-eb5e532b39f0]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:03 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 Jul 21 19:24:03 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:04 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07" returned: 0 in 0.625s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:04 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07 Jul 21 19:24:04 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:04 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4330ef33-1d15-4b33-af2b-d2d8a9281a07" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-4330ef33-1d15-4b33-af2b-d2d8a9281a07" released by "delete_volume" :: held 1.209s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['416cfb44-40d8-4832-bef9-2ba268712ef8', '799436b0-2f68-4455-b75d-6452e55da95b', 'e06b50aa-04df-4ae1-a80c-06bce21bd03f', 'f0ed8ba9-3d35-4191-9e4a-50f2bc63847d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:05 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:05 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:05 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5cfa2eb-6ee7-424d-99a9-3775379a35cf tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-4330ef33-1d15-4b33-af2b-d2d8a9281a07-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[751800fe-bbb4-449f-a311-2b964347ec11]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:06 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc Jul 21 19:24:06 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:06 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" returned: 0 in 0.701s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:06 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc Jul 21 19:24:06 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:07 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770" returned: 0 in 5.186s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a898ffc-9282-48ae-b537-ba1cac62f5de]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:07 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc" released by "delete_volume" :: held 1.162s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:07 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:24:07 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['b1cc4220-83a4-411b-9415-8243e14a2631', 'a1196318-f639-44b7-86aa-0db82468be1a', '29e0c32f-e240-4263-ba47-a9af87222090', 'bc1cc264-a3ce-440c-80e5-b7e946cee1d8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:07 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:07 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:07 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed4b4dc8-355f-4872-8bbf-cbda211ad820 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-aebef78f-9e7f-41ad-be8e-dc28cdb1a8fc-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:07 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:24:07 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Converted 1024.00 MB image at 197.39 MB/s Jul 21 19:24:07 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 is being set with open permissions: ugo+rw Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:07 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 Jul 21 19:24:07 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:07 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" released by "_copy_volume_from_snapshot" :: held 7.069s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-df25c977-b945-4a07-8b92-7d7b5b518770" released by "_create_volume_from_snapshot" :: held 7.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.158s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.393s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c1dd6c-6aa5-40e2-b256-b89c60ed651f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8356ca40881646528ae476fba99bb73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:23:54Z,use_quota=True,user_id='2986cd541db9492c86db1e505d602ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(984f781a-2493-48cc-a487-85dd938897a7),volume_type_id=984f781a-2493-48cc-a487-85dd938897a7)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Creating volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:07 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1073741824 Jul 21 19:24:07 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9c9de1-5a4f-41c2-b175-d16781f1089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df25c977-b945-4a07-8b92-7d7b5b518770', 'volume_size': 1, 'snapshot_id': '68b66ccb-9003-47dc-8ca2-7eb632cb2b80'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d102665-977b-45a7-84c6-cc597909e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Volume volume-df25c977-b945-4a07-8b92-7d7b5b518770 (df25c977-b945-4a07-8b92-7d7b5b518770): created successfully Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d102665-977b-45a7-84c6-cc597909e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Flow 'volume_create_manager' (80532918-3f64-4e62-810b-29e9b9af7904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a16b0cc8-2fa9-43df-88e6-44c2c8b9a1d7 tempest-VolumeDependencyTests-1032809606 None] Created volume successfully. Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-dc0a119d-ec37-484c-8e2e-60028dfe9405-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-dc0a119d-ec37-484c-8e2e-60028dfe9405-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-dc0a119d-ec37-484c-8e2e-60028dfe9405" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-dc0a119d-ec37-484c-8e2e-60028dfe9405" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fceb7b-477f-4677-a209-ff52d648cb10]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:08 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1073741824" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:08 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:08 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:08 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f Jul 21 19:24:08 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:08 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.519s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975882674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbe0487-d569-4661-b6b7-ba8843d661b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:01Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume 7fbe0487-d569-4661-b6b7-ba8843d661b3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:08 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:08 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 1073741824 Jul 21 19:24:08 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Attempting download of db5fd406-d433-4e97-9131-666b49a85ceb ((None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}])) to volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:24:08 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405 Jul 21 19:24:08 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37a48a-6b9b-4a92-aaf7-5548d55a3649]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:08 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88 Jul 21 19:24:08 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-dc0a119d-ec37-484c-8e2e-60028dfe9405" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-dc0a119d-ec37-484c-8e2e-60028dfe9405" released by "delete_volume" :: held 0.726s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Deleting offline snapshot 68b66ccb-9003-47dc-8ca2-7eb632cb2b80 of volume 0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] snapshot_file for this snap is: volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be8ee7-5f3f-4a56-8005-05f9ead0b982]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['1fa414f0-0d53-45c1-8577-96bb568a43e8', '204abc48-4fe0-49b0-b583-3a516269455e', '8424f69e-2269-4812-83f2-8f5c911985e9', 'c6c4f396-5816-4c08-9f00-9e08c758f36d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 1073741824" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:24:09 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 Jul 21 19:24:09 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88 Jul 21 19:24:09 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:09 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-9362aa76-9155-47fc-b061-10b333d9821a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-9362aa76-9155-47fc-b061-10b333d9821a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-9362aa76-9155-47fc-b061-10b333d9821a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-9362aa76-9155-47fc-b061-10b333d9821a" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7823a-e903-4139-ad2c-37ba3e25b08a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.476s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0142e61e-c7fa-4491-9515-64261994f93f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[14411a84-a042-4838-adb5-7f84aed15b31]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.112s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958401088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e908636-98bc-4409-9211-3944418cb791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:01Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume 9e908636-98bc-4409-9211-3944418cb791 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a Jul 21 19:24:09 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:09 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88" returned: 1 in 0.560s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5fd406-d433-4e97-9131-666b49a85ceb_eysr2a88' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b978031d-4975-4dd2-80a9-87a2e8424262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbe0487-d569-4661-b6b7-ba8843d661b3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:09 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 1073741824 Jul 21 19:24:09 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e3ce1-2b67-4837-a497-e3cf1fb27196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25d80a-03c2-4fb6-b18c-cc7e41e485f7]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b225ceab-d803-4d68-8a3d-233aba72a63b tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-dc0a119d-ec37-484c-8e2e-60028dfe9405-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 (7fbe0487-d569-4661-b6b7-ba8843d661b3): created successfully Jul 21 19:24:09 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:24:09 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7e3ce1-2b67-4837-a497-e3cf1fb27196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (b7bef2b1-1b5b-4512-b83d-3cc6ae2cc28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a3aa7a47-e6ed-4bb2-ad79-1a7a1ddefb7f tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:24:09 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:24:09 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a Jul 21 19:24:10 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:24:10 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD Jul 21 19:24:10 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9362aa76-9155-47fc-b061-10b333d9821a" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-9362aa76-9155-47fc-b061-10b333d9821a" released by "delete_volume" :: held 0.781s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 1073741824" returned: 0 in 0.623s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['00663bc1-c0b7-4ae4-9772-61fad2807c67', '076998bc-74c8-4400-b658-2003b08bd072', 'e9396f55-25ba-46ee-b8fc-6a1676516135', '018faf5e-241e-4ddf-9986-b394774b0dd9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:10 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 Jul 21 19:24:10 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] db5fd406-d433-4e97-9131-666b49a85ceb was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:24:10 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:10 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f Jul 21 19:24:10 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80 Jul 21 19:24:10 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-c61dce40-499b-4fb6-a2e0-76b48dd13e06-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:10 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-c61dce40-499b-4fb6-a2e0-76b48dd13e06-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.722s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253984552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e916c6-0de4-4533-a5b0-febf4805318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:02Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume 80e916c6-0de4-4533-a5b0-febf4805318a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:10 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a 1073741824 Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f743b147-1b48-417c-a47c-6770a4c91bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e908636-98bc-4409-9211-3944418cb791', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:10 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2887266-1bcb-40a0-b748-f7c5dd5dffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:10 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-9e908636-98bc-4409-9211-3944418cb791 (9e908636-98bc-4409-9211-3944418cb791): created successfully Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2887266-1bcb-40a0-b748-f7c5dd5dffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (ef9a2e2d-99bc-41a6-8844-a04eba2230e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "cinder-quobyte-c61dce40-499b-4fb6-a2e0-76b48dd13e06" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-648a8d00-3a6f-4728-9c3a-b5d35cab6b55 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e7bcf043-0d3e-4238-a54b-342a260f0d8c tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-9362aa76-9155-47fc-b061-10b333d9821a-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-c61dce40-499b-4fb6-a2e0-76b48dd13e06" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ccbc5-f0c7-42f3-a4b3-1f267c16bc30]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f.68b66ccb-9003-47dc-8ca2-7eb632cb2b80" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-68b66ccb-9003-47dc-8ca2-7eb632cb2b80" released by "_delete_snapshot" :: held 1.977s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" released by "delete_snapshot" :: held 2.008s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:11 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 Jul 21 19:24:11 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Created reservations ['a8c5817e-38e9-4e3c-95f2-eac561074d9a', '611fd9fe-2752-4912-a80f-e60c07a5e339', '31202642-ab82-4bd5-887f-9a6d79b1cdba', '3b62f4ff-e653-48f1-8c34-28f04c613f9d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Delete snapshot completed successfully. Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-765e8007-ce22-4435-bdb1-97151885ddb9 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-68b66ccb-9003-47dc-8ca2-7eb632cb2b80-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:11 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" returned: 0 in 0.711s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5fd406-d433-4e97-9131-666b49a85ceb_a48pps4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1G Jul 21 19:24:11 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:11 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a 1073741824" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a Jul 21 19:24:11 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:11 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06 Jul 21 19:24:11 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:11 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f 1G" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Downloaded image db5fd406-d433-4e97-9131-666b49a85ceb ((None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}])) to volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Temporary image db5fd406-d433-4e97-9131-666b49a85ceb for user 2986cd541db9492c86db1e505d602ff7 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Marking volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Copying metadata from image db5fd406-d433-4e97-9131-666b49a85ceb to 00c1dd6c-6aa5-40e2-b256-b89c60ed651f. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Creating volume glance metadata for volume 00c1dd6c-6aa5-40e2-b256-b89c60ed651f backed by image db5fd406-d433-4e97-9131-666b49a85ceb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ac6d9396d20d4545cdd64ab85934f22a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:24:11 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.177s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983655075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b5daec-c3ca-4711-b6d3-b199868c5a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:02Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume 11b5daec-c3ca-4711-b6d3-b199868c5a80 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:11 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 1073741824 Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c61dce40-499b-4fb6-a2e0-76b48dd13e06" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:11 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d41e83-6030-4618-9b4c-11d13198e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e916c6-0de4-4533-a5b0-febf4805318a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc3081-1566-4837-8ec0-7d0fc7d07db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-quobyte-c61dce40-499b-4fb6-a2e0-76b48dd13e06" released by "delete_volume" :: held 0.824s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-80e916c6-0de4-4533-a5b0-febf4805318a (80e916c6-0de4-4533-a5b0-febf4805318a): created successfully Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc3081-1566-4837-8ec0-7d0fc7d07db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (ea497de6-3c25-4a04-b17c-21688131fc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-89221234-c4b7-41d2-8835-f43478b678ab tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5436c4ac-f711-4c64-a377-37c545a17d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f', 'volume_size': 1, 'image_id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5fd406-d433-4e97-9131-666b49a85ceb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ac6d9396d20d4545cdd64ab85934f22a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8356ca40881646528ae476fba99bb73e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7be12cf01a494f608a03a153b85907b4239600cb642c1a7a2176ccb1d7de207c848bf1ace5252ada35f68d51043db2a0519eb7b395b645f67dd13c2b124a808c', 'id': 'db5fd406-d433-4e97-9131-666b49a85ceb', 'created_at': datetime.datetime(2026, 7, 21, 17, 23, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5fd406-d433-4e97-9131-666b49a85ceb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3265183a-b9ed-477b-a362-f51caf1231f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Volume volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f (00c1dd6c-6aa5-40e2-b256-b89c60ed651f): created successfully Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3265183a-b9ed-477b-a362-f51caf1231f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Flow 'volume_create_manager' (957fb83c-d03f-4f9a-ac20-1d56e4403f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Created reservations ['977ab52e-eef4-43ef-bd54-b99718f439b1', 'e85fd647-098e-48c4-a053-9feba0e18d4b', '26d6f755-b05b-4713-be35-8872af7e1896', 'd63e6846-5d8c-4423-9d16-e5366fb811e5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-355565dd-6972-4c65-b7d9-63f02a0da4b7 tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Created volume successfully. Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:11 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:11 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:12 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 1073741824" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:12 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 Jul 21 19:24:12 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:12 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Deleted volume successfully. Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-0142e61e-c7fa-4491-9515-64261994f93f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ecf06959-46de-42b5-a396-5d5af6d922e4 tempest-CreateVolumesFromSourceVolumeTest-939178216 None] Lock "cinder-c61dce40-499b-4fb6-a2e0-76b48dd13e06-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-0142e61e-c7fa-4491-9515-64261994f93f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715993c-b6d8-4da5-9ad1-65552b12000d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:12 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.485s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713926427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5297e69-01c1-4c7f-8722-fbe196f448b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690030d7cc774bb1a81344508989b943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:03Z,use_quota=True,user_id='34760de56bbf415fa02cae561246bc67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Creating volume a5297e69-01c1-4c7f-8722-fbe196f448b6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:12 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:24:12 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba8e80c-b545-402d-9aa7-4fc78c49bb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b5daec-c3ca-4711-b6d3-b199868c5a80', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dba66cb-b6b4-4139-8292-2215e75cb218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:12 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 1073741824 Jul 21 19:24:12 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 (11b5daec-c3ca-4711-b6d3-b199868c5a80): created successfully Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dba66cb-b6b4-4139-8292-2215e75cb218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (e184e212-0114-4a34-8b03-e82faedfd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-00776c57-35a9-430e-bb65-10174fb05e80 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:24:12 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:12 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f Jul 21 19:24:12 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Acquiring lock "cinder-00c1dd6c-6aa5-40e2-b256-b89c60ed651f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "cinder-00c1dd6c-6aa5-40e2-b256-b89c60ed651f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Acquiring lock "cinder-quobyte-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "cinder-quobyte-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1074c9e-ac99-4d2d-89a6-9896bbcc611f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:13 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-0142e61e-c7fa-4491-9515-64261994f93f" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 1073741824" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-0142e61e-c7fa-4491-9515-64261994f93f" released by "delete_volume" :: held 0.779s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:13 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 Jul 21 19:24:13 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Created reservations ['26af98f8-1241-47e6-9e09-e83d31166c3d', 'cb647078-f358-4f47-9b1c-ed5fe4a10ee4', '579f74a2-ef29-41a0-b373-3aae602539ab', 'b084c4f8-207d-4b57-a938-964b628bc2d2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:13 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f Jul 21 19:24:13 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:13 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:13 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-df25c977-b945-4a07-8b92-7d7b5b518770-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:13 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-df25c977-b945-4a07-8b92-7d7b5b518770-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fbb58-94b3-4d59-a809-f085e03b3be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5297e69-01c1-4c7f-8722-fbe196f448b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92216988-012f-4def-ae96-0566bc6fbf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Volume volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 (a5297e69-01c1-4c7f-8722-fbe196f448b6): created successfully Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92216988-012f-4def-ae96-0566bc6fbf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Flow 'volume_create_manager' (12b18bc9-20e7-484c-af83-25e3e7ddc46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:13 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Deleted volume successfully. Jul 21 19:24:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-62a08969-5c8a-4f7f-a431-414b1ed608cf tempest-CreateVolumesFromSnapshotTest-198052231 None] Created volume successfully. Jul 21 19:24:13 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" returned: 0 in 0.553s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:13 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f Jul 21 19:24:13 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-77825f2e-b344-4973-a6b5-3e1c6f8b2970 tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-0142e61e-c7fa-4491-9515-64261994f93f-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36457e1f-d99d-4fb6-b032-bf3688bd5d51]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:13 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 Jul 21 19:24:13 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:13 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "cinder-quobyte-00c1dd6c-6aa5-40e2-b256-b89c60ed651f" released by "delete_volume" :: held 0.916s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-a5297e69-01c1-4c7f-8722-fbe196f448b6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-a5297e69-01c1-4c7f-8722-fbe196f448b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Created reservations ['138af1bf-1ebf-4d6d-aa9a-80ad937041e6', '1188db7e-84dd-463c-b23d-561d424bd5e0', '8854d014-1f01-43bd-9493-1ee47374c1c9', 'd75eff35-c96c-40e4-bb17-20b5203f1b97'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-a5297e69-01c1-4c7f-8722-fbe196f448b6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-a5297e69-01c1-4c7f-8722-fbe196f448b6" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:14 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35590d51-daac-4286-9a11-65aaa474a8f6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:14 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770 Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:14 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:14 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:14 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:14 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 Jul 21 19:24:14 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:14 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-df25c977-b945-4a07-8b92-7d7b5b518770" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-quobyte-df25c977-b945-4a07-8b92-7d7b5b518770" released by "delete_volume" :: held 0.904s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:14 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Deleted volume successfully. Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c40827ed-3ce3-4fea-89a5-47dd4175a7ef tempest-VolumeAndVolumeTypeFromImageTest-263911088 None] Lock "cinder-00c1dd6c-6aa5-40e2-b256-b89c60ed651f-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:14 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Created reservations ['34766ca0-b65f-4c29-892e-2e57b3170309', 'ad6fcf97-5300-4200-8a8a-577d8f232e81', '7ff74af1-3fee-4273-bf0a-552298f5b26e', 'a4408bf0-2a38-4056-839f-4c119b0cef85'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:14 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6 Jul 21 19:24:14 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:14 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:14 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:14 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5297e69-01c1-4c7f-8722-fbe196f448b6" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-a5297e69-01c1-4c7f-8722-fbe196f448b6" released by "delete_volume" :: held 0.847s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['7df27471-ee77-4ebb-9499-8095a906a7b5', 'cd507b13-4d7f-4e76-af8c-7f8a415056d8', '085f235f-818c-4ff2-a997-934a8aabbee1', '9880688c-6b4f-4ec1-8b15-6ccfcece6f17'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:15 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Deleted volume successfully. Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-881c81cb-9956-4c6e-89ab-de26d1a0ca0f tempest-VolumeDependencyTests-1032809606 None] Lock "cinder-df25c977-b945-4a07-8b92-7d7b5b518770-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:15 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:15 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-11b5daec-c3ca-4711-b6d3-b199868c5a80-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-11b5daec-c3ca-4711-b6d3-b199868c5a80-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-11b5daec-c3ca-4711-b6d3-b199868c5a80" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-11b5daec-c3ca-4711-b6d3-b199868c5a80" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f0b3a-cd24-456e-bfb8-d1bf30cd416a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:15 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 Jul 21 19:24:15 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:15 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2127d2-6db0-4681-af99-4e5e59cc1eee tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-a5297e69-01c1-4c7f-8722-fbe196f448b6-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:15 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:15 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80 Jul 21 19:24:15 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:16 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-11b5daec-c3ca-4711-b6d3-b199868c5a80" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-11b5daec-c3ca-4711-b6d3-b199868c5a80" released by "delete_volume" :: held 0.848s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['4a3bd368-c636-4068-a941-0729abebc6f5', '43a4bb94-abee-4d9f-ad4f-5c526d96668e', '5cfb2d28-71ad-4a77-ad29-885f261495d3', '071156f3-e4d9-47ef-bb54-eeac66accc0a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:16 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:16 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-80e916c6-0de4-4533-a5b0-febf4805318a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-80e916c6-0de4-4533-a5b0-febf4805318a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-80e916c6-0de4-4533-a5b0-febf4805318a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-80e916c6-0de4-4533-a5b0-febf4805318a" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba6be4-391d-487a-9efc-6f6daf9380b8]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:16 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:16 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a Jul 21 19:24:16 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-95b7ae0b-47ef-4a5a-97e2-19a28c8e6455 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-11b5daec-c3ca-4711-b6d3-b199868c5a80-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:17 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:17 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a Jul 21 19:24:17 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:17 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-80e916c6-0de4-4533-a5b0-febf4805318a" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-80e916c6-0de4-4533-a5b0-febf4805318a" released by "delete_volume" :: held 0.919s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['104da295-60b2-4ead-a787-a785db372204', '2208052f-e6e4-4e56-aede-b0e8782777b0', 'c5b5d583-4a11-4edb-a017-51753e7797b0', 'f509797b-04b1-4494-b65d-e9cd9df8ab7d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:17 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:17 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:17 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4db77f6f-1b18-409c-8f11-51ea9992d226 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-80e916c6-0de4-4533-a5b0-febf4805318a-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-9e908636-98bc-4409-9211-3944418cb791-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-9e908636-98bc-4409-9211-3944418cb791-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-9e908636-98bc-4409-9211-3944418cb791" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-9e908636-98bc-4409-9211-3944418cb791" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88752483-d066-4622-91f0-6386bd8d6843]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:19 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 Jul 21 19:24:19 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:19 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:19 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791 Jul 21 19:24:19 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:19 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e908636-98bc-4409-9211-3944418cb791" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-9e908636-98bc-4409-9211-3944418cb791" released by "delete_volume" :: held 0.755s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['1738655f-eff7-4f09-96c6-3f1e9459a487', '594ce557-db5c-40d4-b7ef-b6489d7f8fc9', '44ab8cae-80d9-45c4-ad82-a8d7476ed6c6', '32124fa2-ceee-4515-ae54-809add3d38c9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:19 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:19 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-7fbe0487-d569-4661-b6b7-ba8843d661b3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:20 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-7fbe0487-d569-4661-b6b7-ba8843d661b3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88b4769c-a1ef-4417-b34d-55cfc039291a tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-9e908636-98bc-4409-9211-3944418cb791-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-7fbe0487-d569-4661-b6b7-ba8843d661b3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-7fbe0487-d569-4661-b6b7-ba8843d661b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb86105-3d55-4601-a40d-4e9e49502ee6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:20 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 Jul 21 19:24:20 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:20 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:20 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3 Jul 21 19:24:20 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:21 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-7fbe0487-d569-4661-b6b7-ba8843d661b3" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-7fbe0487-d569-4661-b6b7-ba8843d661b3" released by "delete_volume" :: held 0.872s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['f4c51c96-6167-4e59-83b5-dc5673a4e845', '95198f3b-d750-47af-a476-7657fec854ef', '30c3f601-cb10-4bca-9db4-e9863f29bbcf', '7c9d7f70-b81a-4f79-98c9-9152156e6534'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-27993ecd-9703-49cf-8c20-2b3cea0b16ed-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:21 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:21 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-27993ecd-9703-49cf-8c20-2b3cea0b16ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-27993ecd-9703-49cf-8c20-2b3cea0b16ed" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-27993ecd-9703-49cf-8c20-2b3cea0b16ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleting offline snapshot 27993ecd-9703-49cf-8c20-2b3cea0b16ed of volume 968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] snapshot_file for this snap is: volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c36782-9da6-4ce2-8352-5049326a7ce6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:21 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:21 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed Jul 21 19:24:21 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e85a6a97-c8c7-4d48-b5ee-67463d3d8aa0 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-7fbe0487-d569-4661-b6b7-ba8843d661b3-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (de872769-3f80-4270-9691-73f744d39bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93227450-9e70-40e6-ae4d-d620a9a9a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93227450-9e70-40e6-ae4d-d620a9a9a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1442360003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c96ec9-8bc1-4f35-a997-50776e92a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:22Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c099ca5-4892-4b4b-8a09-23453a447926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c099ca5-4892-4b4b-8a09-23453a447926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6677e17-99e0-4024-8455-a14bd8b4f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6677e17-99e0-4024-8455-a14bd8b4f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c96ec9-8bc1-4f35-a997-50776e92a6e0', 'volume_name': 'volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51500852-5bd8-4cd9-8a27-f8f8cdf8ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51500852-5bd8-4cd9-8a27-f8f8cdf8ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593ca38-a768-4e3a-95d1-7499e8c93a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Volume a5c96ec9-8bc1-4f35-a997-50776e92a6e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0', 'volume_size': 1} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1442360003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c96ec9-8bc1-4f35-a997-50776e92a6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:22Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Creating volume a5c96ec9-8bc1-4f35-a997-50776e92a6e0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:22 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968cd457-90de-4c71-876b-615f15b93aac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:22 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 1073741824 Jul 21 19:24:22 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94426d3e-149c-4732-83c6-9de28fbd4f68]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:22 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac Jul 21 19:24:22 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (671343e0-fa4d-4d9d-9801-9c289293c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eec183f-9b35-49d9-a9f0-b6c801e986c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eec183f-9b35-49d9-a9f0-b6c801e986c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547274728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7ddc3c-5fa4-497a-818c-7a5346a7a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:22Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bd21aa-9cee-4fa9-b0ad-23772c229d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bd21aa-9cee-4fa9-b0ad-23772c229d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eb327c-7b0d-4498-b471-d07393961c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eb327c-7b0d-4498-b471-d07393961c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7ddc3c-5fa4-497a-818c-7a5346a7a932', 'volume_name': 'volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02d6af-11f2-4acf-8220-d559514df373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02d6af-11f2-4acf-8220-d559514df373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b0a2b8-3459-4e9f-9d6a-0f4a4e81410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Volume 9e7ddc3c-5fa4-497a-818c-7a5346a7a932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932', 'volume_size': 1} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:22 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac" returned: 0 in 0.676s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:22 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 1073741824" returned: 0 in 0.824s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:22 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed Jul 21 19:24:22 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:23 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 Jul 21 19:24:23 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (1f95e1a2-bdba-488e-bb38-ce39e26fa0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8753aa91-63ef-4426-ad5c-d31cfbdb57bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8753aa91-63ef-4426-ad5c-d31cfbdb57bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628357987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8905f5b-a6ff-46c3-93ec-871856f39143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:23Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4f019a-ad3e-412f-88c0-b1b56725e146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4f019a-ad3e-412f-88c0-b1b56725e146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27c4e28-3c69-46d9-8da8-b8cf223b6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27c4e28-3c69-46d9-8da8-b8cf223b6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8905f5b-a6ff-46c3-93ec-871856f39143', 'volume_name': 'volume-f8905f5b-a6ff-46c3-93ec-871856f39143', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9f9526-b589-4ec5-a99e-82980557f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9f9526-b589-4ec5-a99e-82980557f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9729879e-a3fd-43ea-88e6-1122c3e70094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Volume f8905f5b-a6ff-46c3-93ec-871856f39143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8905f5b-a6ff-46c3-93ec-871856f39143', 'volume_size': 1} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:23 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:23 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed Jul 21 19:24:23 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:23 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547274728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7ddc3c-5fa4-497a-818c-7a5346a7a932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:22Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Creating volume 9e7ddc3c-5fa4-497a-818c-7a5346a7a932 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593ca38-a768-4e3a-95d1-7499e8c93a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd7f18-106d-4fa5-bbc9-0138c78bc389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 1073741824 Jul 21 19:24:23 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Volume volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 (a5c96ec9-8bc1-4f35-a997-50776e92a6e0): created successfully Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd7f18-106d-4fa5-bbc9-0138c78bc389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (de872769-3f80-4270-9691-73f744d39bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9978c984-d388-473e-bb3d-73b3d95df35f tempest-CreateVolumesFromImageTest-1190175884 None] Created volume successfully. Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (d0537f9a-0ad2-4b3e-9d53-a1d8a206b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ad8401-bde2-4ed2-b24a-3d0a986388a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac.27993ecd-9703-49cf-8c20-2b3cea0b16ed" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ad8401-bde2-4ed2-b24a-3d0a986388a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-40558739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27f53d7-c236-46d5-b675-7c2e80854d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:24Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e63720a-cce7-4f64-ab5a-86144a8f698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e63720a-cce7-4f64-ab5a-86144a8f698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7858d7f5-34c1-4e02-875a-fa37eb761ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7858d7f5-34c1-4e02-875a-fa37eb761ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27f53d7-c236-46d5-b675-7c2e80854d56', 'volume_name': 'volume-b27f53d7-c236-46d5-b675-7c2e80854d56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0500d28f-d6f4-4c58-bb16-a3bc37086ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0500d28f-d6f4-4c58-bb16-a3bc37086ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c6560-5b97-4f4a-a71d-b2cd34a892c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Volume b27f53d7-c236-46d5-b675-7c2e80854d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27f53d7-c236-46d5-b675-7c2e80854d56', 'volume_size': 1} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-27993ecd-9703-49cf-8c20-2b3cea0b16ed" released by "_delete_snapshot" :: held 2.391s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" released by "delete_snapshot" :: held 2.426s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['4278534f-f9d2-406c-8675-629e9d1a6633', '440e176e-598f-427c-895c-8e0259714466', '5baf3fc0-ed52-4da1-8539-d18d48c573af', 'da4a681d-2386-4692-b650-30eb3c5e9467'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Delete snapshot completed successfully. Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d52a604c-64df-45ab-ac25-1c36871142c7 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-27993ecd-9703-49cf-8c20-2b3cea0b16ed-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (440e3d96-653c-467c-aabf-ee38d223d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2624bd4c-0003-4dc4-a798-21c89277de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 1073741824" returned: 0 in 0.771s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2624bd4c-0003-4dc4-a798-21c89277de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917088120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:24Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f16c70-b18a-41a2-bc35-4adb290a39ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f16c70-b18a-41a2-bc35-4adb290a39ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88321cb1-fd14-48dd-8248-8c54bd897fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88321cb1-fd14-48dd-8248-8c54bd897fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1', 'volume_name': 'volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3d8639-f2e4-450e-adc8-75cb2bd845aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3d8639-f2e4-450e-adc8-75cb2bd845aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e659e98-4048-457a-806e-394ffc2c1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Volume 3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1', 'volume_size': 1} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:24 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 Jul 21 19:24:24 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:24 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1628357987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8905f5b-a6ff-46c3-93ec-871856f39143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:23Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Creating volume f8905f5b-a6ff-46c3-93ec-871856f39143 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-968cd457-90de-4c71-876b-615f15b93aac-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:24 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 1073741824 Jul 21 19:24:24 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b0a2b8-3459-4e9f-9d6a-0f4a4e81410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fb807-943d-4859-bb38-7b6fed7de074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-968cd457-90de-4c71-876b-615f15b93aac-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Volume volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 (9e7ddc3c-5fa4-497a-818c-7a5346a7a932): created successfully Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fb807-943d-4859-bb38-7b6fed7de074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (671343e0-fa4d-4d9d-9801-9c289293c58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-68ea18e9-6ba5-43e0-9db8-1f6bf52abdee tempest-CreateVolumesFromImageTest-1190175884 None] Created volume successfully. Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d49ab3-a4d3-4aca-8c17-546aac939b20]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Flow 'volume_create_manager' (2e47d963-001b-455b-b891-eeae1a9e7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3be5b6-3df5-40b1-98d1-6b3e4d8183e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3be5b6-3df5-40b1-98d1-6b3e4d8183e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4306cd1f-94b8-4aba-8c34-2764ee6a293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ad2a961c74421a998d4ccd9edbef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:25Z,use_quota=True,user_id='234e9b4ad1054976a2f06ec505af63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f52d216-6ced-4912-819f-2a17f67cf318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f52d216-6ced-4912-819f-2a17f67cf318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:24 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac Jul 21 19:24:24 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be658984-8eeb-48c6-9f4b-76602b9b9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:24 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 19:24:25 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 1073741824" returned: 0 in 0.559s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 Jul 21 19:24:25 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:25 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac Jul 21 19:24:25 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be658984-8eeb-48c6-9f4b-76602b9b9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4306cd1f-94b8-4aba-8c34-2764ee6a293f', 'volume_name': 'volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f', 'volume_size': 1, 'image_id': '9332475a-da86-4106-aaf2-43baff68ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72f1587b8ea8a76dc4568a3d8f8c0bce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ad2a961c74421a998d4ccd9edbef01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf782b51afc045d3ce5d4f1ceee47086c0d5405967737577d4e281adbb82511bb5b1e412af98c329c521fb836c87da369bcda9c643c62c020fe3c6bf375e62d8', 'id': '9332475a-da86-4106-aaf2-43baff68ce67', 'created_at': datetime.datetime(2026, 7, 21, 17, 24, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 24, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9332475a-da86-4106-aaf2-43baff68ce67/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c1f753-2644-43d2-b57c-94ced7cb60c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c1f753-2644-43d2-b57c-94ced7cb60c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe28c32-4ec4-43b9-9d2f-68cc4910b48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f', 'volume_size': 1, 'image_id': '9332475a-da86-4106-aaf2-43baff68ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72f1587b8ea8a76dc4568a3d8f8c0bce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ad2a961c74421a998d4ccd9edbef01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf782b51afc045d3ce5d4f1ceee47086c0d5405967737577d4e281adbb82511bb5b1e412af98c329c521fb836c87da369bcda9c643c62c020fe3c6bf375e62d8', 'id': '9332475a-da86-4106-aaf2-43baff68ce67', 'created_at': datetime.datetime(2026, 7, 21, 17, 24, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 24, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9332475a-da86-4106-aaf2-43baff68ce67/file', 'properties': {}}, 'image_service': } Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Trying to clone 4306cd1f-94b8-4aba-8c34-2764ee6a293f from image 9332475a-da86-4106-aaf2-43baff68ce67 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 19:24:25 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Image download 0.00 MB at 0.00 MB/s Jul 21 19:24:25 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-968cd457-90de-4c71-876b-615f15b93aac" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:25 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-quobyte-968cd457-90de-4c71-876b-615f15b93aac" released by "delete_volume" :: held 0.818s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-40558739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27f53d7-c236-46d5-b675-7c2e80854d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:24Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Creating volume b27f53d7-c236-46d5-b675-7c2e80854d56 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:25 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 1073741824 Jul 21 19:24:25 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c5f73c-d956-48b0-a760-7d5d472c627a]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9729879e-a3fd-43ea-88e6-1122c3e70094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8905f5b-a6ff-46c3-93ec-871856f39143', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37c04f7-4cf8-41c5-b544-4dba6a845667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Volume volume-f8905f5b-a6ff-46c3-93ec-871856f39143 (f8905f5b-a6ff-46c3-93ec-871856f39143): created successfully Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37c04f7-4cf8-41c5-b544-4dba6a845667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (1f95e1a2-bdba-488e-bb38-ce39e26fa0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ebf3ce36-f47e-4080-ae1d-ed0dd7d28a45 tempest-CreateVolumesFromImageTest-1190175884 None] Created volume successfully. Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:25 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Created reservations ['359aab20-25b5-4fd7-86bd-b12cb9932615', 'efdc8312-dc5a-441c-a36a-8242393cb032', 'f7bfeb41-855a-43e0-9a08-7b4565787609', '15ee0cba-41a8-4b9e-a5e1-6345a84dbaa9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:25 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:25 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:25 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:25 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:26 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:26 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:24:26 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:26 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 1073741824" returned: 0 in 0.657s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Deleted volume successfully. Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc083a54-06fc-49d5-9ac0-520748e1c4a8 tempest-CreateVolumesFromSnapshotTest-198052231 None] Lock "cinder-968cd457-90de-4c71-876b-615f15b93aac-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:26 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 Jul 21 19:24:26 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:26 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Temporary image 9332475a-da86-4106-aaf2-43baff68ce67 is fetched for user 234e9b4ad1054976a2f06ec505af63cd. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a64ac-9e40-413e-a6ce-c4318667c149]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:26 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917088120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e5da9797f24d5bb87d6d7900bd9cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:24Z,use_quota=True,user_id='eddf10b9e5be4f56aa7416fa1e685537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Creating volume 3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:26 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 1073741824 Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744c6560-5b97-4f4a-a71d-b2cd34a892c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27f53d7-c236-46d5-b675-7c2e80854d56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:26 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8594e0bb-3e58-4061-b003-8f3d747a36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Volume volume-b27f53d7-c236-46d5-b675-7c2e80854d56 (b27f53d7-c236-46d5-b675-7c2e80854d56): created successfully Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8594e0bb-3e58-4061-b003-8f3d747a36fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (d0537f9a-0ad2-4b3e-9d53-a1d8a206b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:26 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:26 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6a981943-2027-40fe-b14c-d60c692c3fe1 tempest-CreateVolumesFromImageTest-1190175884 None] Created volume successfully. Jul 21 19:24:26 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:27 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:27 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:27 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 1073741824" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:27 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 Jul 21 19:24:27 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:27 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:27 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4306cd1f-94b8-4aba-8c34-2764ee6a293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ad2a961c74421a998d4ccd9edbef01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:25Z,use_quota=True,user_id='234e9b4ad1054976a2f06ec505af63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Creating volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e659e98-4048-457a-806e-394ffc2c1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:27 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1073741824 Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2795b1-f508-4d49-bd7b-c34c49158458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:27 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Volume volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 (3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1): created successfully Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2795b1-f508-4d49-bd7b-c34c49158458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Flow 'volume_create_manager' (440e3d96-653c-467c-aabf-ee38d223d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e93343ce-b94b-47bb-b32d-391b29b39962 tempest-CreateVolumesFromImageTest-1190175884 None] Created volume successfully. Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-quobyte-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[972383c2-d1d8-49e1-8c89-f27b7e4e21b4]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:28 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1073741824" returned: 0 in 0.634s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:28 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 Jul 21 19:24:28 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:28 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f Jul 21 19:24:28 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:28 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Attempting download of 9332475a-da86-4106-aaf2-43baff68ce67 ((None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}])) to volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 19:24:28 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:28 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1 Jul 21 19:24:28 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877c515-9ec1-4cf1-9775-8348a2776268]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:28 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we Jul 21 19:24:28 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:28 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1" released by "delete_volume" :: held 0.843s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Created reservations ['595a85ba-3ebc-4dcb-8468-799bd6c0db04', '9ccddcee-4a8d-46df-9cac-e43c34d68629', '18cfa471-9216-404e-8df2-f74295b43557', '4eb57226-9c46-48eb-b416-533175d229ae'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:28 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:29 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:29 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-b27f53d7-c236-46d5-b675-7c2e80854d56-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-b27f53d7-c236-46d5-b675-7c2e80854d56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-quobyte-b27f53d7-c236-46d5-b675-7c2e80854d56" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-b27f53d7-c236-46d5-b675-7c2e80854d56" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:29 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we Jul 21 19:24:29 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f970ad-0cf5-4d79-a038-8e8819bcefd2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:29 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 Jul 21 19:24:29 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:29 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Deleted volume successfully. Jul 21 19:24:29 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we" returned: 1 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9332475a-da86-4106-aaf2-43baff68ce67_2pcto1we' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4837ce-e31d-4e20-b2ff-c15a6ad0df54]: (4, 'raw') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-235f54e0-307d-4eb1-a36e-bcf535000c03 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-3dbdfd5d-66a4-452f-a4bd-8e3825dafcb1-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:29 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:29 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:29 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:29 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56 Jul 21 19:24:29 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:29 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:29 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b27f53d7-c236-46d5-b675-7c2e80854d56" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-b27f53d7-c236-46d5-b675-7c2e80854d56" released by "delete_volume" :: held 0.854s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:30 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD Jul 21 19:24:30 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Created reservations ['fce5cefa-bc23-41ed-95b4-b9d068fb698b', 'd17400c2-5dec-418e-8803-2ff5eca77429', '1c47e520-737f-4300-a7be-b91e1cb695f9', '4313ffa6-9e0f-4db5-bdc3-3822266c2a00'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:30 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:30 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-f8905f5b-a6ff-46c3-93ec-871856f39143-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:30 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-f8905f5b-a6ff-46c3-93ec-871856f39143-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD" returned: 1 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] 9332475a-da86-4106-aaf2-43baff68ce67 was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:30 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f Jul 21 19:24:30 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-quobyte-f8905f5b-a6ff-46c3-93ec-871856f39143" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-f8905f5b-a6ff-46c3-93ec-871856f39143" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef1dac-0c0d-4055-ab0e-547fd7245549]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:30 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Deleted volume successfully. Jul 21 19:24:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1738ee9-e0ed-4295-89bb-29bf5dd06c74 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-b27f53d7-c236-46d5-b675-7c2e80854d56-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:30 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 Jul 21 19:24:30 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:31 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:31 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143 Jul 21 19:24:31 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:31 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f" returned: 0 in 0.666s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9332475a-da86-4106-aaf2-43baff68ce67_p2qe2wl_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:24:31 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:31 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1G Jul 21 19:24:31 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:31 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f8905f5b-a6ff-46c3-93ec-871856f39143" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-f8905f5b-a6ff-46c3-93ec-871856f39143" released by "delete_volume" :: held 0.866s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Created reservations ['ea0727fa-4b3e-43c6-8d84-07149ab5c794', '383a0fc6-0cba-4bc6-a084-25a59cab2fd3', '880e81e5-9f8b-4efa-84ae-1d9899ceec3a', '51957631-1d0f-41ab-8af2-7afebc717b7b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:31 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f 1G" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Downloaded image 9332475a-da86-4106-aaf2-43baff68ce67 ((None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}])) to volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Temporary image 9332475a-da86-4106-aaf2-43baff68ce67 for user 234e9b4ad1054976a2f06ec505af63cd is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Marking volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Copying metadata from image 9332475a-da86-4106-aaf2-43baff68ce67 to 4306cd1f-94b8-4aba-8c34-2764ee6a293f. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Creating volume glance metadata for volume 4306cd1f-94b8-4aba-8c34-2764ee6a293f backed by image 9332475a-da86-4106-aaf2-43baff68ce67 with: {'image_id': '9332475a-da86-4106-aaf2-43baff68ce67', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '72f1587b8ea8a76dc4568a3d8f8c0bce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-9e7ddc3c-5fa4-497a-818c-7a5346a7a932-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:31 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:31 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-9e7ddc3c-5fa4-497a-818c-7a5346a7a932-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-quobyte-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe28c32-4ec4-43b9-9d2f-68cc4910b48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f', 'volume_size': 1, 'image_id': '9332475a-da86-4106-aaf2-43baff68ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9332475a-da86-4106-aaf2-43baff68ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72f1587b8ea8a76dc4568a3d8f8c0bce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90ad2a961c74421a998d4ccd9edbef01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf782b51afc045d3ce5d4f1ceee47086c0d5405967737577d4e281adbb82511bb5b1e412af98c329c521fb836c87da369bcda9c643c62c020fe3c6bf375e62d8', 'id': '9332475a-da86-4106-aaf2-43baff68ce67', 'created_at': datetime.datetime(2026, 7, 21, 17, 24, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 17, 24, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9332475a-da86-4106-aaf2-43baff68ce67/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87dba53-9d2b-49ae-bdfe-02d62d8c3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Volume volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f (4306cd1f-94b8-4aba-8c34-2764ee6a293f): created successfully Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87dba53-9d2b-49ae-bdfe-02d62d8c3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Flow 'volume_create_manager' (2e47d963-001b-455b-b891-eeae1a9e7323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" acquired by "delete_volume" :: waited 0.068s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8938fdd8-604b-4c30-a1db-c0a9107ea5f1 tempest-VolumeImageDependencyTests-143149832 None] Created volume successfully. Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8981c738-4ca6-493e-b7cb-a3cbcd834bed]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:31 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Deleted volume successfully. Jul 21 19:24:31 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 Jul 21 19:24:31 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5e099f3-b6b0-4070-81c6-9647a363ed84 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-f8905f5b-a6ff-46c3-93ec-871856f39143-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:32 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:32 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932 Jul 21 19:24:32 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Acquiring lock "cinder-4306cd1f-94b8-4aba-8c34-2764ee6a293f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "cinder-4306cd1f-94b8-4aba-8c34-2764ee6a293f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:32 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-9e7ddc3c-5fa4-497a-818c-7a5346a7a932" released by "delete_volume" :: held 0.853s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Acquiring lock "cinder-quobyte-4306cd1f-94b8-4aba-8c34-2764ee6a293f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "cinder-quobyte-4306cd1f-94b8-4aba-8c34-2764ee6a293f" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c1cb48-871c-4fbf-85a7-4977d470027f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Created reservations ['0e8eca90-fa27-484b-a096-1a7b37931027', 'd6cf9a55-54a7-4b63-b7c0-4ae6899aa829', '59f0d438-3d12-4a35-a3bb-22ecdd30dfd2', '6b229081-02bd-4ddb-970c-5aa97989ef1e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:32 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f Jul 21 19:24:32 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:32 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:32 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:33 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Deleted volume successfully. Jul 21 19:24:33 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54ba69a0-2b66-4426-96de-b3a29cb42e13 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-9e7ddc3c-5fa4-497a-818c-7a5346a7a932-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f" returned: 0 in 0.487s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:33 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f Jul 21 19:24:33 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:33 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-4306cd1f-94b8-4aba-8c34-2764ee6a293f" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "cinder-quobyte-4306cd1f-94b8-4aba-8c34-2764ee6a293f" released by "delete_volume" :: held 0.844s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Created reservations ['4e327e18-869d-4a18-b9e2-530cb69c968a', 'c0bc8e08-d03f-417f-8b97-25789b1935d2', '6323cf53-b245-4b4e-9be5-9d9fb4ee9fed', 'd4ce248d-ec0a-4efa-9128-3c6f8dbb4ed9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:33 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:33 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-a5c96ec9-8bc1-4f35-a997-50776e92a6e0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-a5c96ec9-8bc1-4f35-a997-50776e92a6e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "cinder-quobyte-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:34 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124b68a-531b-45c0-8f3c-357d33a2334a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Deleted volume successfully. Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0e4b9c-ee07-40d8-83af-1ad616a19c19 tempest-VolumeImageDependencyTests-143149832 None] Lock "cinder-4306cd1f-94b8-4aba-8c34-2764ee6a293f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:34 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 Jul 21 19:24:34 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:34 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:34 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0 Jul 21 19:24:34 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:34 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-quobyte-a5c96ec9-8bc1-4f35-a997-50776e92a6e0" released by "delete_volume" :: held 0.890s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Created reservations ['976ddd9f-6b73-45d4-98f1-90c02a0baad0', 'a45b9017-507a-42db-8222-619cc09001e9', 'd2808092-282c-4332-a9e2-e736214ce00f', '09d3177c-3136-4663-80f3-671850c9ebc5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:35 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:35 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:35 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Deleted volume successfully. Jul 21 19:24:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8ab43631-7b36-466e-9f3a-4b53f0f69948 tempest-CreateVolumesFromImageTest-1190175884 None] Lock "cinder-a5c96ec9-8bc1-4f35-a997-50776e92a6e0-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (466099f8-6f87-41ab-a02f-be9509b5b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c3c340-a2a5-4f0a-ac1c-e1c8aac94c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c3c340-a2a5-4f0a-ac1c-e1c8aac94c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909359113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2244c8b7-baec-452d-a1ea-038ac6b22412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:37Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cae743-7449-4841-b595-0ceb4a8c1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cae743-7449-4841-b595-0ceb4a8c1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d962f2f1-514b-4735-9f3d-ea7afc979c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d962f2f1-514b-4735-9f3d-ea7afc979c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2244c8b7-baec-452d-a1ea-038ac6b22412', 'volume_name': 'volume-2244c8b7-baec-452d-a1ea-038ac6b22412', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788792ca-72dd-47c3-8276-6c265a187e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788792ca-72dd-47c3-8276-6c265a187e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fcdf43-2b4c-411a-9def-1dd9c69f9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Volume 2244c8b7-baec-452d-a1ea-038ac6b22412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2244c8b7-baec-452d-a1ea-038ac6b22412', 'volume_size': 1} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909359113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2244c8b7-baec-452d-a1ea-038ac6b22412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:37Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Creating volume 2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:37 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 1073741824 Jul 21 19:24:37 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:38 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 1073741824" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:38 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 Jul 21 19:24:38 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:38 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fcdf43-2b4c-411a-9def-1dd9c69f9fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2244c8b7-baec-452d-a1ea-038ac6b22412', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c44c34-03a4-4edc-91a1-fa973119b415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Volume volume-2244c8b7-baec-452d-a1ea-038ac6b22412 (2244c8b7-baec-452d-a1ea-038ac6b22412): created successfully Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c44c34-03a4-4edc-91a1-fa973119b415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (466099f8-6f87-41ab-a02f-be9509b5b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6761917f-ffaf-4a1a-b486-e888268123d7 tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:24:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-63366c30-75bb-4e13-8d84-8a128a1e72b3 tempest-ProjectAdminTests-440350983 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7378044128418, 'free_capacity_gb': 1775.7378044128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot b4b452fa-14e3-4822-8e08-b7485ab24a31 of volume 2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c060a63-ea21-4fa8-b7a0-8850a36ab649]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:40 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 Jul 21 19:24:40 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:40 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:40 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 1G Jul 21 19:24:40 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Flow 'volume_create_manager' (04854cd8-4ba4-4696-a1e4-bf9b3d98ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f9883e-9589-4ca3-860a-5595f3451f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f9883e-9589-4ca3-860a-5595f3451f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c2b838-8f44-484a-8140-8f7a78845248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a58eeef24e34cb6a0d0d4b3ca2e85f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:41Z,use_quota=True,user_id='5df982c0edec4919ac521270c9688787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e61ec0b-f273-4612-9d76-b65b4936ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e61ec0b-f273-4612-9d76-b65b4936ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe252d0-9314-46e4-bc94-56896c45d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe252d0-9314-46e4-bc94-56896c45d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c2b838-8f44-484a-8140-8f7a78845248', 'volume_name': 'volume-71c2b838-8f44-484a-8140-8f7a78845248', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d413e6f0-412a-4061-8854-da1221dda299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d413e6f0-412a-4061-8854-da1221dda299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006435c2-532b-426f-93ce-ccebc521c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Volume 71c2b838-8f44-484a-8140-8f7a78845248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c2b838-8f44-484a-8140-8f7a78845248', 'volume_size': 1} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:41 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 1G" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2244c8b7-baec-452d-a1ea-038ac6b22412 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:41 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2244c8b7-baec-452d-a1ea-038ac6b22412 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 Jul 21 19:24:41 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:41 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2244c8b7-baec-452d-a1ea-038ac6b22412 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 is being set with open permissions: ugo+rw Jul 21 19:24:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:41 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 Jul 21 19:24:41 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:42 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=189,cinder:UPDATE=238,cinder:INSERT=65,cinder:DELETE=24 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=265,cinder:SELECT=176,cinder:DELETE=21,cinder:INSERT=69 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:42 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info Jul 21 19:24:42 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:42 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:42 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info is being set with open permissions: ugo+rw Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:42 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info Jul 21 19:24:42 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:42 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.info" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c2b838-8f44-484a-8140-8f7a78845248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a58eeef24e34cb6a0d0d4b3ca2e85f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:41Z,use_quota=True,user_id='5df982c0edec4919ac521270c9688787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Creating volume 71c2b838-8f44-484a-8140-8f7a78845248 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:42 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 1073741824 Jul 21 19:24:42 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81db0038-138f-47a1-8605-19a739452800 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:24:43 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 1073741824" returned: 0 in 0.603s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:43 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 Jul 21 19:24:43 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-b4b452fa-14e3-4822-8e08-b7485ab24a31-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-b4b452fa-14e3-4822-8e08-b7485ab24a31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-b4b452fa-14e3-4822-8e08-b7485ab24a31" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b4b452fa-14e3-4822-8e08-b7485ab24a31" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot b4b452fa-14e3-4822-8e08-b7485ab24a31 of volume 2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d80a2-1027-497c-abaf-d2e20455d4ea]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:43 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006435c2-532b-426f-93ce-ccebc521c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c2b838-8f44-484a-8140-8f7a78845248', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196b1e3f-c3ff-47ec-998c-453f2cbd1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:43 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 Jul 21 19:24:43 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Volume volume-71c2b838-8f44-484a-8140-8f7a78845248 (71c2b838-8f44-484a-8140-8f7a78845248): created successfully Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196b1e3f-c3ff-47ec-998c-453f2cbd1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Flow 'volume_create_manager' (04854cd8-4ba4-4696-a1e4-bf9b3d98ed24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-79e744b1-8da1-4174-8459-7f6c58ba7d43 tempest-CinderUnicodeTest-2044867200 None] Created volume successfully. Jul 21 19:24:44 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31" returned: 0 in 0.516s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2244c8b7-baec-452d-a1ea-038ac6b22412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f465780-a106-437b-b6d8-527ee6ce1b4b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:44 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 Jul 21 19:24:44 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (8b1cd5a7-a7b2-43c6-9a94-2fb6f0185b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c54837-eb1b-44a3-936e-fa216c318e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c54837-eb1b-44a3-936e-fa216c318e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438307347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a5ea6-5f37-49d9-8a69-98d6a4747fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:44Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17719312-7c7c-4c92-ba41-e6ec520f9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17719312-7c7c-4c92-ba41-e6ec520f9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b65fa9c-6c6d-4104-b852-95ccb87bdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b65fa9c-6c6d-4104-b852-95ccb87bdffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4a5ea6-5f37-49d9-8a69-98d6a4747fab', 'volume_name': 'volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda20b6d-f813-4ce0-a9e7-4cfcc44e28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda20b6d-f813-4ce0-a9e7-4cfcc44e28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d3d0cf-1637-4e7d-98ed-1b339f2dcf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Volume cc4a5ea6-5f37-49d9-8a69-98d6a4747fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab', 'volume_size': 1} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438307347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a5ea6-5f37-49d9-8a69-98d6a4747fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:44Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Creating volume cc4a5ea6-5f37-49d9-8a69-98d6a4747fab {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:44 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab 1073741824 Jul 21 19:24:44 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:44 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:44 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 Jul 21 19:24:44 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Flow 'volume_create_manager' (d8b667a7-b3de-4ff2-96c9-cd74a9ef9bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff123e89-ada8-462d-997a-90f97b890628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff123e89-ada8-462d-997a-90f97b890628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-110551413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a58eeef24e34cb6a0d0d4b3ca2e85f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:45Z,use_quota=True,user_id='5df982c0edec4919ac521270c9688787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46f63a-96dc-45a8-b448-8cb5a3fb6d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46f63a-96dc-45a8-b448-8cb5a3fb6d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf4d05c-12f8-49f9-bfdc-a57e22c849de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf4d05c-12f8-49f9-bfdc-a57e22c849de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f', 'volume_name': 'volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03c6612-259b-418b-9a7c-bbdc41e59945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03c6612-259b-418b-9a7c-bbdc41e59945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8aab6f-2728-460b-8c92-3d915a7b2fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Volume 9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f', 'volume_size': 1} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:44 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab 1073741824" returned: 0 in 0.495s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:44 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab Jul 21 19:24:44 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:44 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:44 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31 Jul 21 19:24:44 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:45 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-110551413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a58eeef24e34cb6a0d0d4b3ca2e85f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:45Z,use_quota=True,user_id='5df982c0edec4919ac521270c9688787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Creating volume 9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:45 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:45 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412.b4b452fa-14e3-4822-8e08-b7485ab24a31" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d3d0cf-1637-4e7d-98ed-1b339f2dcf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:45 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f 1073741824 Jul 21 19:24:45 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6222d25-19e6-4cab-8cf5-42846de0e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Volume volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab (cc4a5ea6-5f37-49d9-8a69-98d6a4747fab): created successfully Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6222d25-19e6-4cab-8cf5-42846de0e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (8b1cd5a7-a7b2-43c6-9a94-2fb6f0185b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b4b452fa-14e3-4822-8e08-b7485ab24a31" released by "_delete_snapshot" :: held 1.856s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" released by "delete_snapshot" :: held 1.887s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-111ac894-aa93-4bba-bbbf-1681043d221b tempest-ProjectReaderTests-1188462739 None] Created volume successfully. Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Created reservations ['d1b7b373-fec9-4574-96c5-ba0f1a4a9ade', 'b75bf028-c947-4d7f-b6f6-b11d995cf388', 'ee6a568c-0476-41c6-9f72-dd8ce7af6676', '1eb90ed2-ca75-4ef7-971b-986bb0229a3b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4edd7906-d799-4178-96eb-60b23aa2b344 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-b4b452fa-14e3-4822-8e08-b7485ab24a31-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:45 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f 1073741824" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:45 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f Jul 21 19:24:45 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-2244c8b7-baec-452d-a1ea-038ac6b22412-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-2244c8b7-baec-452d-a1ea-038ac6b22412-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbd110-2f1b-4a9e-a275-7252a11aad2e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:46 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8aab6f-2728-460b-8c92-3d915a7b2fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129e8ee0-6624-421a-890c-8f52e2aa3ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Volume volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f (9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f): created successfully Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129e8ee0-6624-421a-890c-8f52e2aa3ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Flow 'volume_create_manager' (d8b667a7-b3de-4ff2-96c9-cd74a9ef9bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cd8320c2-808d-4d38-8dd4-eb94c9a6d52e tempest-CinderUnicodeTest-2044867200 None] Created volume successfully. Jul 21 19:24:46 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 Jul 21 19:24:46 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:46 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:46 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412 Jul 21 19:24:46 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-quobyte-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3568308-6953-4900-b3ed-d89688d48bef]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:46 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-2244c8b7-baec-452d-a1ea-038ac6b22412" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-2244c8b7-baec-452d-a1ea-038ac6b22412" released by "delete_volume" :: held 0.738s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Created reservations ['02474df7-9b46-4efe-9edd-784f5ba4fe6a', '1b84de87-5095-4a01-9152-1710499160e6', 'c2fc2cdf-9df8-42b8-8b1e-b64e9622b356', 'c197b196-f4b3-4d59-bc46-d8538423e476'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:46 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab Jul 21 19:24:46 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:46 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:46 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Creating offline snapshot 138f15b3-1dc1-40f9-accd-97d8043eb75f of volume 9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ec461-68dc-45c6-81cb-b884b6c4a3ba]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:47 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:47 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab Jul 21 19:24:47 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:47 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:47 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f Jul 21 19:24:47 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36fbfa43-fd02-446e-a0d4-c679f2912099 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-2244c8b7-baec-452d-a1ea-038ac6b22412-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:47 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab" released by "delete_volume" :: held 0.988s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Created reservations ['673b0879-1066-430e-95c2-cbf457681b51', '99bee6d0-7e2f-4199-bc3f-f0947e5602c3', '8fd9cc9c-c80a-4e45-8b4a-3433079d3d6a', '9268958b-f3db-4a07-b14d-7c2f98601e2b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" returned: 0 in 0.658s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:47 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f 1G Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:47 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (bfeb260e-43cb-444f-9c35-af9edb3c2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:47 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f7901a-594c-48be-8b81-1e72e6c21673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f7901a-594c-48be-8b81-1e72e6c21673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188494164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9c0f83-e648-4af9-a8fa-6296e6755f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:48Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646b74a-fb93-43b0-b036-73bc1d8e1115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0646b74a-fb93-43b0-b036-73bc1d8e1115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20929162-5fcd-4485-a3dc-129dac3f8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20929162-5fcd-4485-a3dc-129dac3f8949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9c0f83-e648-4af9-a8fa-6296e6755f11', 'volume_name': 'volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d004bcc8-ad88-4bde-b881-c0da6393b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d004bcc8-ad88-4bde-b881-c0da6393b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2fd6f8-84e6-404a-a7a6-ffb5d17594b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Volume 8d9c0f83-e648-4af9-a8fa-6296e6755f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11', 'volume_size': 1} Jul 21 19:24:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:48 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Deleted volume successfully. Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d63dabf-55dc-48a0-b2bb-45b04405d927 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-cc4a5ea6-5f37-49d9-8a69-98d6a4747fab-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:48 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f 1G" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:48 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f Jul 21 19:24:48 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:48 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f is being set with open permissions: ugo+rw Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:48 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f Jul 21 19:24:48 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:48 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:48 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info Jul 21 19:24:48 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:49 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info is being set with open permissions: ugo+rw Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:49 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info Jul 21 19:24:49 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (81c63128-abd2-4b49-ab4d-74d3ed3f6c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622e2e02-f760-40af-823c-e4ba89c8b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622e2e02-f760-40af-823c-e4ba89c8b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996097033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adafcfb-d69c-4950-8782-ac727c15615d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:49Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d8f65-8201-486c-a232-27c31db6d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d8f65-8201-486c-a232-27c31db6d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9c486-d333-479b-a522-903c61aa96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9c486-d333-479b-a522-903c61aa96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adafcfb-d69c-4950-8782-ac727c15615d', 'volume_name': 'volume-1adafcfb-d69c-4950-8782-ac727c15615d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff39a4-8f0c-42a2-b689-1abb5fdefde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff39a4-8f0c-42a2-b689-1abb5fdefde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819020b1-7248-4cd0-a022-e037f8db1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Volume 1adafcfb-d69c-4950-8782-ac727c15615d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adafcfb-d69c-4950-8782-ac727c15615d', 'volume_size': 1} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:49 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.info" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188494164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9c0f83-e648-4af9-a8fa-6296e6755f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:48Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Creating volume 8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:49 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 1073741824 Jul 21 19:24:49 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ef79093c-11c4-4d33-957e-1b561a47bc18 tempest-CinderUnicodeTest-2044867200 None] Create snapshot completed successfully Jul 21 19:24:49 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 1073741824" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:49 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 Jul 21 19:24:49 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:50 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996097033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adafcfb-d69c-4950-8782-ac727c15615d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:49Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Creating volume 1adafcfb-d69c-4950-8782-ac727c15615d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2fd6f8-84e6-404a-a7a6-ffb5d17594b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:50 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d 1073741824 Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3ccd4d-1577-4560-95dd-839253a970e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:50 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-138f15b3-1dc1-40f9-accd-97d8043eb75f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Volume volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 (8d9c0f83-e648-4af9-a8fa-6296e6755f11): created successfully Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3ccd4d-1577-4560-95dd-839253a970e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (bfeb260e-43cb-444f-9c35-af9edb3c2818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-138f15b3-1dc1-40f9-accd-97d8043eb75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-931bd530-33c0-4979-a8aa-23d820ce4a4f tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-quobyte-138f15b3-1dc1-40f9-accd-97d8043eb75f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-138f15b3-1dc1-40f9-accd-97d8043eb75f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Deleting offline snapshot 138f15b3-1dc1-40f9-accd-97d8043eb75f of volume 9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] snapshot_file for this snap is: volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fea1d2-a615-4776-806b-6fcdc03331ee]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:50 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f Jul 21 19:24:50 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d 1073741824" returned: 0 in 0.604s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:50 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:50 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d Jul 21 19:24:50 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c1e967-ba96-4269-bc0b-cca897ef865c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:51 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f Jul 21 19:24:51 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:51 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819020b1-7248-4cd0-a022-e037f8db1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adafcfb-d69c-4950-8782-ac727c15615d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c52c76-de85-4e15-bda5-3d6b7b0c737c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 585d9fc0-d636-4945-b825-93de105adc23 of volume 8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:24:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Volume volume-1adafcfb-d69c-4950-8782-ac727c15615d (1adafcfb-d69c-4950-8782-ac727c15615d): created successfully Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c52c76-de85-4e15-bda5-3d6b7b0c737c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (81c63128-abd2-4b49-ab4d-74d3ed3f6c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[404dfe3f-1046-4da3-819a-2ffa3439a51d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a6a6d437-e57e-43b7-a777-acd9013f31ef tempest-ProjectReaderTests-1188462739 None] Created volume successfully. Jul 21 19:24:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:51 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f Jul 21 19:24:51 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:51 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 Jul 21 19:24:51 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:51 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:51 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 1G Jul 21 19:24:51 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:51 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:51 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f Jul 21 19:24:51 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:52 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f.138f15b3-1dc1-40f9-accd-97d8043eb75f" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-138f15b3-1dc1-40f9-accd-97d8043eb75f" released by "_delete_snapshot" :: held 1.745s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" released by "delete_snapshot" :: held 1.772s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Created reservations ['01d0bf33-200e-4d6c-86ed-5d36b33a5e60', '82cd6234-3dc3-4385-aac6-60b24f795627', '1e33c5de-5df1-49bf-a7c2-d14621f2f0a5', '0572181f-c9e8-4487-81e4-aa7808158da0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:52 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 1G" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:52 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 Jul 21 19:24:52 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Delete snapshot completed successfully. Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9feb87cc-9b50-4620-87ea-99d61bbc271a tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-138f15b3-1dc1-40f9-accd-97d8043eb75f-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-1adafcfb-d69c-4950-8782-ac727c15615d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "cinder-1adafcfb-d69c-4950-8782-ac727c15615d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:52 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 is being set with open permissions: ugo+rw Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:52 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 Jul 21 19:24:52 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-quobyte-1adafcfb-d69c-4950-8782-ac727c15615d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a55e6-3f26-48d6-bcb0-4ebf8f1f2316]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-1adafcfb-d69c-4950-8782-ac727c15615d" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767f74d-b644-49df-9b1a-5ee4f34508a8]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:52 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f Jul 21 19:24:52 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:52 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d Jul 21 19:24:52 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:52 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info Jul 21 19:24:53 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f Jul 21 19:24:53 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d Jul 21 19:24:53 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info is being set with open permissions: ugo+rw Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info Jul 21 19:24:53 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f" released by "delete_volume" :: held 0.821s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:53 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Created reservations ['3fe50d15-bbcd-47ad-bf6b-e41505947589', '4a962a56-b18b-4348-9b07-240241c5e1a7', '4cf73ef0-39dc-489d-8956-a960f11f7483', '046dbe0a-48aa-4fb7-af73-97c91bb20f6b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1adafcfb-d69c-4950-8782-ac727c15615d" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-1adafcfb-d69c-4950-8782-ac727c15615d" released by "delete_volume" :: held 0.831s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:53 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.info" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-74233f4f-b1fe-49af-aa37-d55181c4081f tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Created reservations ['d761669c-a978-46d4-82ae-db21c843e865', 'fad43190-f812-4876-9767-5de7b6203c09', '0ca0461e-dd81-4056-8f54-4fa3af122e28', '93cda888-111e-4205-8f93-3596ca7ca27b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:53 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:53 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-71c2b838-8f44-484a-8140-8f7a78845248-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:53 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:53 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-71c2b838-8f44-484a-8140-8f7a78845248-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "cinder-quobyte-71c2b838-8f44-484a-8140-8f7a78845248" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-71c2b838-8f44-484a-8140-8f7a78845248" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf5a09f-56f6-40bf-ab21-ae1fe7cf2f03]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:54 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Deleted volume successfully. Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7b0d5d32-9bf2-4514-9080-a458959c6b59 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-9e8cf7c5-1ee0-4cb8-b070-6fe5d9d5d11f-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:54 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 Jul 21 19:24:54 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Flow 'volume_create_manager' (58e2bee3-d97b-4ed7-9b28-aa4807619bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d05d51-515d-4700-bcb6-65fed5e29b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:54 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Deleted volume successfully. Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d05d51-515d-4700-bcb6-65fed5e29b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74764113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7144e86-a289-4def-bec9-c78eb2a98d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7840aafd7d84b7c99b4da9b4a255d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:54Z,use_quota=True,user_id='24f6bfca44c54e6f885ecd13eda20b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908ea3c1-73d7-405a-8ad8-aa5028fa7d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908ea3c1-73d7-405a-8ad8-aa5028fa7d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b12877-cfa4-4e7e-80ee-2a11188af170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b12877-cfa4-4e7e-80ee-2a11188af170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7144e86-a289-4def-bec9-c78eb2a98d42', 'volume_name': 'volume-a7144e86-a289-4def-bec9-c78eb2a98d42', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7deb2f-089c-4b1d-ab19-dc1b174840fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7deb2f-089c-4b1d-ab19-dc1b174840fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad356cb8-4f3e-4f51-8a63-e34b4a88bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Volume a7144e86-a289-4def-bec9-c78eb2a98d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7144e86-a289-4def-bec9-c78eb2a98d42', 'volume_size': 1} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74764113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7144e86-a289-4def-bec9-c78eb2a98d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7840aafd7d84b7c99b4da9b4a255d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:54Z,use_quota=True,user_id='24f6bfca44c54e6f885ecd13eda20b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Creating volume a7144e86-a289-4def-bec9-c78eb2a98d42 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:54 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 1073741824 Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a853daa-4e37-4522-b477-5a5c78152c3a tempest-ProjectReaderTests-1188462739 None] Lock "cinder-1adafcfb-d69c-4950-8782-ac727c15615d-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:54 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-585d9fc0-d636-4945-b825-93de105adc23-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-585d9fc0-d636-4945-b825-93de105adc23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-585d9fc0-d636-4945-b825-93de105adc23" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-585d9fc0-d636-4945-b825-93de105adc23" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 585d9fc0-d636-4945-b825-93de105adc23 of volume 8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a989260-8d49-4dd2-8b7e-9b63ac1ab102]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:54 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:54 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248 Jul 21 19:24:54 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:54 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 Jul 21 19:24:54 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:54 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 1073741824" returned: 0 in 0.501s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-71c2b838-8f44-484a-8140-8f7a78845248" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-quobyte-71c2b838-8f44-484a-8140-8f7a78845248" released by "delete_volume" :: held 0.812s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:54 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 Jul 21 19:24:54 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:54 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Created reservations ['44043cf6-51a0-47b0-b47c-f848e2d18ccc', '73606ed4-6e32-4adb-91f9-d2acc30f05e5', 'f31050b0-dfe5-48ed-948f-b9b0d4187f88', '098fc943-10d6-4e02-9050-c8f18fc69606'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4376ef0a-3192-4f36-befc-3e5f6214963a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:55 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:55 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:55 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 Jul 21 19:24:55 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:55 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad356cb8-4f3e-4f51-8a63-e34b4a88bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7144e86-a289-4def-bec9-c78eb2a98d42', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6a3ef5-77c1-41a6-88e9-f14e45046821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Volume volume-a7144e86-a289-4def-bec9-c78eb2a98d42 (a7144e86-a289-4def-bec9-c78eb2a98d42): created successfully Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6a3ef5-77c1-41a6-88e9-f14e45046821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Flow 'volume_create_manager' (58e2bee3-d97b-4ed7-9b28-aa4807619bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba53e824-4b28-4479-b263-24ccf47875b0 tempest-ProjectReaderTests-777176701 None] Created volume successfully. Jul 21 19:24:55 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Deleted volume successfully. Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55ab8173-ad94-4680-9720-ea54a0593476 tempest-CinderUnicodeTest-2044867200 None] Lock "cinder-71c2b838-8f44-484a-8140-8f7a78845248-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:55 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (a31aa682-a090-4a92-a2d0-50e0d6724342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba82c39-da99-48a3-8d34-c16b43288fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11" returned: 0 in 0.513s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba82c39-da99-48a3-8d34-c16b43288fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553012816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04111aaa-8140-4e86-b2ff-20a7bcb6d6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:55Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 Jul 21 19:24:55 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99961056-cac0-4237-a500-d0a6694abb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99961056-cac0-4237-a500-d0a6694abb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0d9ddb-78b6-4d0d-bb21-df7013c10bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0d9ddb-78b6-4d0d-bb21-df7013c10bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04111aaa-8140-4e86-b2ff-20a7bcb6d6da', 'volume_name': 'volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba54cc4-06e6-41d4-8cc2-9e0bfc0e594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba54cc4-06e6-41d4-8cc2-9e0bfc0e594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afe4828-61a0-4911-8de8-13bb5a0fad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Volume 04111aaa-8140-4e86-b2ff-20a7bcb6d6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da', 'volume_size': 1} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553012816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04111aaa-8140-4e86-b2ff-20a7bcb6d6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:55Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Creating volume 04111aaa-8140-4e86-b2ff-20a7bcb6d6da {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:55 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da 1073741824 Jul 21 19:24:55 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:55 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:55 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23 Jul 21 19:24:55 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:56 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da 1073741824" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:56 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11.585d9fc0-d636-4945-b825-93de105adc23" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:56 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da Jul 21 19:24:56 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-585d9fc0-d636-4945-b825-93de105adc23" released by "_delete_snapshot" :: held 1.711s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" released by "delete_snapshot" :: held 1.740s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Created reservations ['100df949-0d44-4067-b34c-7eaadbda6886', 'eb624643-dafb-46bd-8bc7-f3b237a3cfb6', '3797c337-d7ab-4723-84e9-d3e411290e9d', '276d4b9c-503c-4531-9c05-3fd241a0c17b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fce53062-1d40-48ed-8218-b3fb616db2a4 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-585d9fc0-d636-4945-b825-93de105adc23-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:56 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afe4828-61a0-4911-8de8-13bb5a0fad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b4075b-1e73-4803-bc6c-17d04bc9b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Volume volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da (04111aaa-8140-4e86-b2ff-20a7bcb6d6da): created successfully Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b4075b-1e73-4803-bc6c-17d04bc9b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (a31aa682-a090-4a92-a2d0-50e0d6724342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d3d0c2b4-09e6-4c14-8e3a-06b67f05cf01 tempest-ProjectReaderTests-1188462739 None] Created volume successfully. Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Acquiring lock "cinder-a7144e86-a289-4def-bec9-c78eb2a98d42-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-8d9c0f83-e648-4af9-a8fa-6296e6755f11-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "cinder-8d9c0f83-e648-4af9-a8fa-6296e6755f11-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "cinder-a7144e86-a289-4def-bec9-c78eb2a98d42-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Acquiring lock "cinder-quobyte-a7144e86-a289-4def-bec9-c78eb2a98d42" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "cinder-quobyte-a7144e86-a289-4def-bec9-c78eb2a98d42" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[122618dc-6642-4053-bea3-43058b77b297]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32813bad-6248-4a60-8d72-210bc6bf28d5]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:56 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 Jul 21 19:24:56 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:56 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 Jul 21 19:24:56 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:57 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11 Jul 21 19:24:57 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:57 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:57 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42 Jul 21 19:24:57 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:57 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-8d9c0f83-e648-4af9-a8fa-6296e6755f11" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-8d9c0f83-e648-4af9-a8fa-6296e6755f11" released by "delete_volume" :: held 0.732s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:57 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-a7144e86-a289-4def-bec9-c78eb2a98d42" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "cinder-quobyte-a7144e86-a289-4def-bec9-c78eb2a98d42" released by "delete_volume" :: held 0.785s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Created reservations ['12b09298-55ae-4c8f-9f2e-b77155b5852c', '9e31a1e9-1a58-4e21-9acb-a4586f1d55da', 'b4acb58b-1480-453a-807a-1617f32e3ef7', '9a93e024-1391-4041-ac7e-96b0fb781946'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-04111aaa-8140-4e86-b2ff-20a7bcb6d6da-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Created reservations ['a3cfff48-778b-4982-a2c4-aab54c452ac8', 'b651f3d6-5140-42b7-82c7-0ec91cf27937', '486f8228-2056-4f34-a38d-ecb52facd221', '2ba0bbba-bde5-423f-ad89-8aed7f24f5aa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:57 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:57 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-04111aaa-8140-4e86-b2ff-20a7bcb6d6da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-quobyte-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e29b6f-d4c7-4203-bf25-b68229250e8f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:24:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:57 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:57 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:58 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da Jul 21 19:24:58 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:58 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b9733ea1-f78c-4dbd-99ac-cb546315025c tempest-ProjectMemberTests-1718051275 None] Lock "cinder-8d9c0f83-e648-4af9-a8fa-6296e6755f11-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:58 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Deleted volume successfully. Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b02bb1d4-da97-4b83-bc97-342fb741b8a0 tempest-ProjectReaderTests-777176701 None] Lock "cinder-a7144e86-a289-4def-bec9-c78eb2a98d42-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:58 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:58 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da Jul 21 19:24:58 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (b1c6b0fa-46de-471d-8871-e785a00e3d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbd212-fbb9-4d38-9fc7-3f67c8a32e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbd212-fbb9-4d38-9fc7-3f67c8a32e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2038740729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c8ff29-fa8c-47bc-a1c2-90664bf9da15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:58Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1c43b-629c-4456-9d72-37f8deee7756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b1c43b-629c-4456-9d72-37f8deee7756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97ca4f6-8f77-4c4d-a63a-87392ba6316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97ca4f6-8f77-4c4d-a63a-87392ba6316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c8ff29-fa8c-47bc-a1c2-90664bf9da15', 'volume_name': 'volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43686a57-9a4e-43bf-8b8d-fb7cef1ad4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43686a57-9a4e-43bf-8b8d-fb7cef1ad4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83925f93-584d-4d06-8872-5a8292f31fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Volume 44c8ff29-fa8c-47bc-a1c2-90664bf9da15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15', 'volume_size': 1} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2038740729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c8ff29-fa8c-47bc-a1c2-90664bf9da15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:58Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Creating volume 44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:58 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:58 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 1073741824 Jul 21 19:24:58 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-04111aaa-8140-4e86-b2ff-20a7bcb6d6da" released by "delete_volume" :: held 0.772s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Created reservations ['6d7a7bf7-4587-4686-9d95-f42bbf40d546', '43403872-2247-4fc7-a2b8-703e6303a8f6', 'acaa7dfb-1bee-4ceb-8585-8ac824d85aeb', '474b5426-053b-4f42-b2b9-eb3273e27a9e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:58 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:24:58 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:58 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:24:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Deleted volume successfully. Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb1e6a7e-9c8e-4693-914c-17e42673e845 tempest-ProjectReaderTests-1188462739 None] Lock "cinder-04111aaa-8140-4e86-b2ff-20a7bcb6d6da-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:24:59 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 1073741824" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:59 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 Jul 21 19:24:59 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:59 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83925f93-584d-4d06-8872-5a8292f31fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d997f17d-6f01-498b-9f59-094f10c31fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Volume volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 (44c8ff29-fa8c-47bc-a1c2-90664bf9da15): created successfully Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d997f17d-6f01-498b-9f59-094f10c31fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (b1c6b0fa-46de-471d-8871-e785a00e3d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f46b006e-88e4-46f9-92b3-603f84cdd0bb tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (54025e56-043e-4055-8aa4-66873778ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b0770-cca7-46e9-a9ae-bbcd74cef2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b0770-cca7-46e9-a9ae-bbcd74cef2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849403668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952ef366-1429-4c1a-8339-0d7416067a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:59Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d52e8-f1e0-4ea3-963c-f7a5b877236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d52e8-f1e0-4ea3-963c-f7a5b877236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3b9eb0-4090-42dc-bd90-df6d7f309933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3b9eb0-4090-42dc-bd90-df6d7f309933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952ef366-1429-4c1a-8339-0d7416067a1e', 'volume_name': 'volume-952ef366-1429-4c1a-8339-0d7416067a1e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac181e68-8b10-4b6e-9d20-c955d0c56d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac181e68-8b10-4b6e-9d20-c955d0c56d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b647e03-5abb-4e83-80a1-00f2650b39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Volume 952ef366-1429-4c1a-8339-0d7416067a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952ef366-1429-4c1a-8339-0d7416067a1e', 'volume_size': 1} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849403668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952ef366-1429-4c1a-8339-0d7416067a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baec8e06c3504fbbb9ab3ca782c5b557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:24:59Z,use_quota=True,user_id='90151269e57544ee84b5cc5ff881c7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Creating volume 952ef366-1429-4c1a-8339-0d7416067a1e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:24:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:24:59 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e 1073741824 Jul 21 19:24:59 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Flow 'volume_create_manager' (f469ea4f-02c1-4918-90c6-bcd46c1ff2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be996b11-a7e8-4e58-bc39-e2c116e4446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be996b11-a7e8-4e58-bc39-e2c116e4446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707074929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aeb02c-1224-4b17-9352-28704f5a1fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7840aafd7d84b7c99b4da9b4a255d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:00Z,use_quota=True,user_id='24f6bfca44c54e6f885ecd13eda20b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06aac71-df4a-4ed7-992f-4d9599ebb73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06aac71-df4a-4ed7-992f-4d9599ebb73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031da741-e836-4d60-a7b9-fd13e785f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031da741-e836-4d60-a7b9-fd13e785f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17aeb02c-1224-4b17-9352-28704f5a1fa3', 'volume_name': 'volume-17aeb02c-1224-4b17-9352-28704f5a1fa3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71858c3a-b0b2-445d-b0bb-3edbf6b0f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71858c3a-b0b2-445d-b0bb-3edbf6b0f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b48af2-f733-43e5-9a7c-9424ce131a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:24:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Volume 17aeb02c-1224-4b17-9352-28704f5a1fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17aeb02c-1224-4b17-9352-28704f5a1fa3', 'volume_size': 1} Jul 21 19:24:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:00 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e 1073741824" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:00 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e Jul 21 19:25:00 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:00 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707074929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aeb02c-1224-4b17-9352-28704f5a1fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7840aafd7d84b7c99b4da9b4a255d94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:00Z,use_quota=True,user_id='24f6bfca44c54e6f885ecd13eda20b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Creating volume 17aeb02c-1224-4b17-9352-28704f5a1fa3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b647e03-5abb-4e83-80a1-00f2650b39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952ef366-1429-4c1a-8339-0d7416067a1e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d0f708-92d7-465a-8473-806662ddbd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:00 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 1073741824 Jul 21 19:25:00 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Volume volume-952ef366-1429-4c1a-8339-0d7416067a1e (952ef366-1429-4c1a-8339-0d7416067a1e): created successfully Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d0f708-92d7-465a-8473-806662ddbd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Flow 'volume_create_manager' (54025e56-043e-4055-8aa4-66873778ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a8509f21-71ee-4eb3-bb0f-819b51b4e6e1 tempest-ProjectReaderTests-1188462739 None] Created volume successfully. Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:00 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 1073741824" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:00 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 Jul 21 19:25:00 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:01 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.437s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b48af2-f733-43e5-9a7c-9424ce131a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aeb02c-1224-4b17-9352-28704f5a1fa3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4465e9-610c-49ec-a5d6-dc480a8e6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 1c855b01-7052-4382-9bc2-81a3c2bd2f1e of volume 44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Volume volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 (17aeb02c-1224-4b17-9352-28704f5a1fa3): created successfully Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4465e9-610c-49ec-a5d6-dc480a8e6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Flow 'volume_create_manager' (f469ea4f-02c1-4918-90c6-bcd46c1ff2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d845d-c3c8-4ab2-8266-0324346c88b1]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-03233ec1-21e3-44a5-83b1-30c64ef69657 tempest-ProjectReaderTests-777176701 None] Created volume successfully. Jul 21 19:25:01 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 Jul 21 19:25:01 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-952ef366-1429-4c1a-8339-0d7416067a1e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "cinder-952ef366-1429-4c1a-8339-0d7416067a1e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Acquiring lock "cinder-quobyte-952ef366-1429-4c1a-8339-0d7416067a1e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Acquiring lock "cinder-17aeb02c-1224-4b17-9352-28704f5a1fa3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:01 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-952ef366-1429-4c1a-8339-0d7416067a1e" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "cinder-17aeb02c-1224-4b17-9352-28704f5a1fa3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba5339-00a6-41fa-952c-e7111c52b09e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:01 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e 1G Jul 21 19:25:01 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Acquiring lock "cinder-quobyte-17aeb02c-1224-4b17-9352-28704f5a1fa3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "cinder-quobyte-17aeb02c-1224-4b17-9352-28704f5a1fa3" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[793333dc-db44-43d3-896f-24159eefe149]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:01 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e Jul 21 19:25:01 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:01 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 Jul 21 19:25:01 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e 1G" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e Jul 21 19:25:02 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e Jul 21 19:25:02 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3 Jul 21 19:25:02 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-952ef366-1429-4c1a-8339-0d7416067a1e" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "cinder-quobyte-952ef366-1429-4c1a-8339-0d7416067a1e" released by "delete_volume" :: held 0.703s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:02 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e is being set with open permissions: ugo+rw Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Created reservations ['45f6378e-21e2-495d-b489-b98960e02600', 'c8d2a1e4-d35b-4c8e-866d-cdec3d33f5a7', 'a47ae1a5-5c63-4b7d-a755-d9c8d894f7f6', 'fd170941-dd65-49dd-bc78-c0927d6eefcc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:02 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e Jul 21 19:25:02 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-17aeb02c-1224-4b17-9352-28704f5a1fa3" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "cinder-quobyte-17aeb02c-1224-4b17-9352-28704f5a1fa3" released by "delete_volume" :: held 0.711s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Created reservations ['d7651b4b-eb02-435c-8c33-2338e8aa4ee9', '6fb6c4b6-65ab-48cb-9067-82d3249c21f9', 'd6d1ede1-bf8d-4637-97e5-b0f3058c2e0b', '7f6bc751-a1a1-4c58-a3f3-b009f02a1cce'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:02 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:02 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:02 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info Jul 21 19:25:02 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:02 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Deleted volume successfully. Jul 21 19:25:02 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Deleted volume successfully. Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-56fdc1e4-edec-43de-b94d-55d8b244359d tempest-ProjectReaderTests-777176701 None] Lock "cinder-17aeb02c-1224-4b17-9352-28704f5a1fa3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee1fc3c1-10e3-4214-b178-a2497c48feac tempest-ProjectReaderTests-1188462739 None] Lock "cinder-952ef366-1429-4c1a-8339-0d7416067a1e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:03 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:03 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info is being set with open permissions: ugo+rw Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:03 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info Jul 21 19:25:03 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:03 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.info" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ebc07109-6b1e-42ad-95a2-f4363c10fb34 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-1c855b01-7052-4382-9bc2-81a3c2bd2f1e-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-1c855b01-7052-4382-9bc2-81a3c2bd2f1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-1c855b01-7052-4382-9bc2-81a3c2bd2f1e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1c855b01-7052-4382-9bc2-81a3c2bd2f1e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 1c855b01-7052-4382-9bc2-81a3c2bd2f1e of volume 44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d6cd68-37ad-42bc-a5e1-c0640fa09031]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:04 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e Jul 21 19:25:04 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:04 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffdf461-27e7-49f4-bf01-def1f3044709]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:04 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 Jul 21 19:25:04 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:05 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:05 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e Jul 21 19:25:05 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:05 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:05 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e Jul 21 19:25:05 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:05 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15.1c855b01-7052-4382-9bc2-81a3c2bd2f1e" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1c855b01-7052-4382-9bc2-81a3c2bd2f1e" released by "_delete_snapshot" :: held 1.642s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" released by "delete_snapshot" :: held 1.669s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Created reservations ['bf725d5b-b9ff-4b76-8eca-a8423dc7ac69', 'aa35e482-9f15-42be-9c18-3ba001f1bc0e', '3dd6b1fb-6d6d-47a5-b1b2-2f8adbf98f23', '9d6f71fb-50fa-4bf4-9f1e-8e44b53a88cf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b9151d2-7a45-4a6e-93f6-886d5269ab7e tempest-ProjectMemberTests-1718051275 None] Lock "cinder-1c855b01-7052-4382-9bc2-81a3c2bd2f1e-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-44c8ff29-fa8c-47bc-a1c2-90664bf9da15-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-44c8ff29-fa8c-47bc-a1c2-90664bf9da15-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fa132c-7cde-4cd7-b666-c87b9c5549bd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:06 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 Jul 21 19:25:06 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:06 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:06 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15 Jul 21 19:25:06 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:06 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-44c8ff29-fa8c-47bc-a1c2-90664bf9da15" released by "delete_volume" :: held 0.644s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Created reservations ['509b6a8a-f2d9-472a-b6d8-c798a0ea8f0b', '7469a526-f311-4dc2-884f-a611f43f2d6c', '7b37b781-a366-4b8e-b320-c7bb2a03e2ef', 'a0b6f43b-2d03-4360-976c-e7056ba4d4a5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:06 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:06 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:07 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-52905b54-3872-4906-9b1e-437cc748fc53 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-44c8ff29-fa8c-47bc-a1c2-90664bf9da15-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (8a8fdae4-f337-4b91-b406-d3976af89d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c545924a-759d-4906-af3b-c11fb5347566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c545924a-759d-4906-af3b-c11fb5347566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846893296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da01220f-8679-496d-b66b-211a3eeb8935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:08Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e576f7-7fc9-4e7b-9b5a-f363ad9f1b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e576f7-7fc9-4e7b-9b5a-f363ad9f1b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7061ef0a-ab33-462b-9799-6d6776aa8b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7061ef0a-ab33-462b-9799-6d6776aa8b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da01220f-8679-496d-b66b-211a3eeb8935', 'volume_name': 'volume-da01220f-8679-496d-b66b-211a3eeb8935', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f093d5-8e71-4cb9-a2b4-b55f256fccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f093d5-8e71-4cb9-a2b4-b55f256fccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d891b33-b7f2-4dfa-8cb0-67e23950d232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Volume da01220f-8679-496d-b66b-211a3eeb8935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da01220f-8679-496d-b66b-211a3eeb8935', 'volume_size': 1} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846893296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da01220f-8679-496d-b66b-211a3eeb8935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:08Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Creating volume da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:07 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 1073741824 Jul 21 19:25:07 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:08 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 1073741824" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:08 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 Jul 21 19:25:08 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:08 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d891b33-b7f2-4dfa-8cb0-67e23950d232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da01220f-8679-496d-b66b-211a3eeb8935', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3199b-f46c-4a9f-a78c-fc0b8a30bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Volume volume-da01220f-8679-496d-b66b-211a3eeb8935 (da01220f-8679-496d-b66b-211a3eeb8935): created successfully Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf3199b-f46c-4a9f-a78c-fc0b8a30bf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (8a8fdae4-f337-4b91-b406-d3976af89d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cd9ee25a-26d7-43fd-8fd5-35d7ac5c86a8 tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot a76f0c66-e539-47c7-b89b-c732d5cff506 of volume da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129008b-7fb0-452e-87f8-4df0516ec84e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:08 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 Jul 21 19:25:08 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:09 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:09 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 1G Jul 21 19:25:09 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:09 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 1G" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da01220f-8679-496d-b66b-211a3eeb8935 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:09 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da01220f-8679-496d-b66b-211a3eeb8935 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 Jul 21 19:25:09 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:09 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da01220f-8679-496d-b66b-211a3eeb8935 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 is being set with open permissions: ugo+rw Jul 21 19:25:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:09 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 Jul 21 19:25:09 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:10 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:10 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info Jul 21 19:25:10 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:10 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info is being set with open permissions: ugo+rw Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:10 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info Jul 21 19:25:10 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:10 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.info" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4b1f7a5c-f413-4fed-b760-5ad9131bc0b1 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-a76f0c66-e539-47c7-b89b-c732d5cff506-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-a76f0c66-e539-47c7-b89b-c732d5cff506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-a76f0c66-e539-47c7-b89b-c732d5cff506" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-a76f0c66-e539-47c7-b89b-c732d5cff506" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot a76f0c66-e539-47c7-b89b-c732d5cff506 of volume da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8b0ac-a0a7-4998-b18e-a6fb409a6a8d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:11 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 Jul 21 19:25:11 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:11 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da01220f-8679-496d-b66b-211a3eeb8935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[966ef707-c5dd-4024-b8e9-351002b2af71]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:11 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 Jul 21 19:25:11 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:11 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:11 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 Jul 21 19:25:11 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:12 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:12 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506 Jul 21 19:25:12 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:12 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935.a76f0c66-e539-47c7-b89b-c732d5cff506" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-a76f0c66-e539-47c7-b89b-c732d5cff506" released by "_delete_snapshot" :: held 1.393s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" released by "delete_snapshot" :: held 1.413s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Created reservations ['86b7a518-fcd1-4cf0-9388-5e47a49d047f', '0e487af9-1f2c-4e22-8736-92ba7e021935', '301b54c4-a02b-4a4f-b8a9-1696efac338a', '16352074-9911-4c9c-a1b1-3ece03660fab'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba867c3f-5a29-4f13-9e14-0d094072a45d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-a76f0c66-e539-47c7-b89b-c732d5cff506-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-da01220f-8679-496d-b66b-211a3eeb8935-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-da01220f-8679-496d-b66b-211a3eeb8935-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dbb2cc-b9cb-49f7-ab12-2d8ba317a1df]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:13 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 Jul 21 19:25:13 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:13 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:13 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935 Jul 21 19:25:13 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:13 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-da01220f-8679-496d-b66b-211a3eeb8935" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-da01220f-8679-496d-b66b-211a3eeb8935" released by "delete_volume" :: held 0.645s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Created reservations ['1efdc718-4d67-4d3e-8843-eea5d338fdd1', '176d81ed-844e-44b1-870c-1681f81068a4', 'a5ab96de-309a-48db-99b8-08248dca8545', 'a68e5dd2-c12d-484f-9b13-00650f3fbb62'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:13 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:13 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:14 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9cf71910-381b-4a4e-b973-6e8f16c722b8 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-da01220f-8679-496d-b66b-211a3eeb8935-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (d892ac0c-f033-4637-b9ed-72afa041d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f28b07-6420-44ee-8c34-c0d9869606f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f28b07-6420-44ee-8c34-c0d9869606f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92781557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c307efc7-e864-4acd-a7bf-311e5f550590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:15Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f61f8-6cee-46ba-82aa-02a614d6578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70f61f8-6cee-46ba-82aa-02a614d6578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1dd18a-fd5d-46be-856a-c5ff94a48e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1dd18a-fd5d-46be-856a-c5ff94a48e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c307efc7-e864-4acd-a7bf-311e5f550590', 'volume_name': 'volume-c307efc7-e864-4acd-a7bf-311e5f550590', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842efeff-0ffd-441a-a206-e86b08bc1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (842efeff-0ffd-441a-a206-e86b08bc1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43196fbb-0016-4422-9aba-20b6ac5bf36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Volume c307efc7-e864-4acd-a7bf-311e5f550590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c307efc7-e864-4acd-a7bf-311e5f550590', 'volume_size': 1} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92781557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c307efc7-e864-4acd-a7bf-311e5f550590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:15Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Creating volume c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:14 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 1073741824 Jul 21 19:25:14 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:15 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 1073741824" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:15 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 Jul 21 19:25:15 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:15 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43196fbb-0016-4422-9aba-20b6ac5bf36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c307efc7-e864-4acd-a7bf-311e5f550590', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25542648-5653-48d7-8592-8024093f945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Volume volume-c307efc7-e864-4acd-a7bf-311e5f550590 (c307efc7-e864-4acd-a7bf-311e5f550590): created successfully Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25542648-5653-48d7-8592-8024093f945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (d892ac0c-f033-4637-b9ed-72afa041d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba4e25c8-19b3-42fd-8502-93a7502a7992 tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 6b6c7f19-14b3-4db9-8c04-2331ea2068d8 of volume c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2a060b-d778-4682-8ae4-eeb46796d920]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:16 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 Jul 21 19:25:16 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:16 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:16 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 1G Jul 21 19:25:16 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:16 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 1G" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c307efc7-e864-4acd-a7bf-311e5f550590 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:16 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c307efc7-e864-4acd-a7bf-311e5f550590 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 Jul 21 19:25:16 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:16 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c307efc7-e864-4acd-a7bf-311e5f550590 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:16 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 is being set with open permissions: ugo+rw Jul 21 19:25:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:16 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 Jul 21 19:25:16 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:17 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:17 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info Jul 21 19:25:17 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:17 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info is being set with open permissions: ugo+rw Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:17 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info Jul 21 19:25:17 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:17 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.info" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8308203c-a6ca-4320-aa86-cdb47080f60b tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-6b6c7f19-14b3-4db9-8c04-2331ea2068d8-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-6b6c7f19-14b3-4db9-8c04-2331ea2068d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-6b6c7f19-14b3-4db9-8c04-2331ea2068d8" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-6b6c7f19-14b3-4db9-8c04-2331ea2068d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 6b6c7f19-14b3-4db9-8c04-2331ea2068d8 of volume c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac390d1f-4c62-4e84-8039-c6dcb8dbba2f]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:18 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 Jul 21 19:25:18 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:18 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c307efc7-e864-4acd-a7bf-311e5f550590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c471b-8447-457f-a772-fcc0f55dcc3a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:18 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 Jul 21 19:25:18 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:18 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:18 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 Jul 21 19:25:18 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:19 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:19 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8 Jul 21 19:25:19 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:19 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590.6b6c7f19-14b3-4db9-8c04-2331ea2068d8" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-6b6c7f19-14b3-4db9-8c04-2331ea2068d8" released by "_delete_snapshot" :: held 1.356s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" released by "delete_snapshot" :: held 1.377s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Created reservations ['1736cf05-d4bb-42a9-b4d1-0d2e96b166ec', 'f73353aa-454a-4ee6-828a-642d867d177f', '32c5ee19-544a-4f49-9ade-e1aa0c2df140', '421a8ef3-7d98-41ea-92ff-4fb0fbb8b0e0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-837f30e2-0f9b-435e-b0f3-a392050a3a8b tempest-ProjectMemberTests-1718051275 None] Lock "cinder-6b6c7f19-14b3-4db9-8c04-2331ea2068d8-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-c307efc7-e864-4acd-a7bf-311e5f550590-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-c307efc7-e864-4acd-a7bf-311e5f550590-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4eb8cd-e4c2-415a-8ad2-85af3e76d63e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:20 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 Jul 21 19:25:20 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:20 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:20 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590 Jul 21 19:25:20 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:20 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-c307efc7-e864-4acd-a7bf-311e5f550590" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-c307efc7-e864-4acd-a7bf-311e5f550590" released by "delete_volume" :: held 0.641s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Created reservations ['d31fb926-54a5-4fd2-8978-f3890c325163', '7582f2b3-b272-4fe7-ab62-49d69d92694d', '4d1ab15b-946c-4e94-9f2b-ac99c1d322f3', '54831fef-a176-47a8-837d-fdffcfa46cb1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:20 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:20 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:21 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f5eea3a2-14f5-4635-a610-ff6c68decd50 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-c307efc7-e864-4acd-a7bf-311e5f550590-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (03a1935a-a49d-4078-9138-dd53edb47e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbd020b-e778-406b-989c-654c5142bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbd020b-e778-406b-989c-654c5142bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967956490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb0c1da-615b-4fb0-8c1d-546b4feb9da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:22Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c4f266-eaad-4c84-ba41-504faa352ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c4f266-eaad-4c84-ba41-504faa352ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa11768-1bc8-4644-a919-bf7dc087334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa11768-1bc8-4644-a919-bf7dc087334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb0c1da-615b-4fb0-8c1d-546b4feb9da1', 'volume_name': 'volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f79f1f3-c9a9-4410-9037-fa95735de6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f79f1f3-c9a9-4410-9037-fa95735de6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eded0c39-a317-4bb2-b093-944946e0f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Volume 1fb0c1da-615b-4fb0-8c1d-546b4feb9da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1', 'volume_size': 1} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967956490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb0c1da-615b-4fb0-8c1d-546b4feb9da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:22Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Creating volume 1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:21 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 1073741824 Jul 21 19:25:21 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:22 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 1073741824" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:22 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 Jul 21 19:25:22 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:22 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eded0c39-a317-4bb2-b093-944946e0f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da21ed18-5686-471c-ade3-88a293e734c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Volume volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 (1fb0c1da-615b-4fb0-8c1d-546b4feb9da1): created successfully Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da21ed18-5686-471c-ade3-88a293e734c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (03a1935a-a49d-4078-9138-dd53edb47e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cfbd02b5-a38f-4b72-a36e-39e47994bc16 tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 46aece15-6ecb-4b71-80fe-54d6b59714b5 of volume 1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[327be927-0a39-44c7-98e0-d76388c24e18]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:22 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 Jul 21 19:25:22 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:23 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:23 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 1G Jul 21 19:25:23 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:23 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 1G" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:23 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 Jul 21 19:25:23 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:23 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 is being set with open permissions: ugo+rw Jul 21 19:25:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:23 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 Jul 21 19:25:23 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:24 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:24 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info Jul 21 19:25:24 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:24 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:24 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info is being set with open permissions: ugo+rw Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:24 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info Jul 21 19:25:24 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:24 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.info" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b47bea4b-76b5-449c-a10b-bc3a61b8e111 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-46aece15-6ecb-4b71-80fe-54d6b59714b5-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-46aece15-6ecb-4b71-80fe-54d6b59714b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-46aece15-6ecb-4b71-80fe-54d6b59714b5" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-46aece15-6ecb-4b71-80fe-54d6b59714b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 46aece15-6ecb-4b71-80fe-54d6b59714b5 of volume 1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3478e84-652a-4e8c-a6ca-6e20bb197d9e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:25 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 Jul 21 19:25:25 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:25 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b289eb07-4b79-4d01-bc7a-8f1eb7fb5d64]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:25 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 Jul 21 19:25:25 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:25 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:25 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:25 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:25 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 Jul 21 19:25:25 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:25 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:25:26 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:26 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5 Jul 21 19:25:26 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:26 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1.46aece15-6ecb-4b71-80fe-54d6b59714b5" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-46aece15-6ecb-4b71-80fe-54d6b59714b5" released by "_delete_snapshot" :: held 1.431s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" released by "delete_snapshot" :: held 1.452s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Created reservations ['1999563a-2981-42bd-b734-f48c55371a95', 'e3eeff79-a5d1-42f0-948a-71aa01543be5', '47ae2f57-9692-4b28-abd8-941294c1318a', '72b6b1f9-f258-4a4a-a921-c31f1f676e1c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bac468e9-a480-44ef-8d82-31a12a24f231 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-46aece15-6ecb-4b71-80fe-54d6b59714b5-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d3bf5-4f49-49eb-85b6-55d8ee6bb39b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:27 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 Jul 21 19:25:27 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:27 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:27 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1 Jul 21 19:25:27 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:27 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Created reservations ['02ece6db-71ed-4305-bc51-2dec065227dc', 'be13298b-a70f-446a-aac9-d4efec457953', '0a3904e2-b8eb-4e38-b7b1-02b9d9704a4e', 'fd29adfb-f8fa-4b23-b284-badfcd813ab5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:27 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:27 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:28 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ebe40635-1b80-4ac6-9a77-b4528ace2b5d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-1fb0c1da-615b-4fb0-8c1d-546b4feb9da1-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (eac1549b-255b-4e79-877a-6e36e12e4c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d9a5c0-38e9-4977-aae6-cac0208aa98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d9a5c0-38e9-4977-aae6-cac0208aa98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145982140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14e6c2c-c610-47d5-8219-c9434d458523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:29Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eabc34-e061-4286-af30-fdbedf64d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21eabc34-e061-4286-af30-fdbedf64d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af75afa9-1737-47d4-a70c-f878d290fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af75afa9-1737-47d4-a70c-f878d290fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14e6c2c-c610-47d5-8219-c9434d458523', 'volume_name': 'volume-b14e6c2c-c610-47d5-8219-c9434d458523', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27931044-d1f0-43c7-bef1-92d3c8ca6ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27931044-d1f0-43c7-bef1-92d3c8ca6ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca316db-378c-4268-bde4-9218b2cd54c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Volume b14e6c2c-c610-47d5-8219-c9434d458523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14e6c2c-c610-47d5-8219-c9434d458523', 'volume_size': 1} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-145982140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14e6c2c-c610-47d5-8219-c9434d458523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:29Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Creating volume b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:28 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 1073741824 Jul 21 19:25:28 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:29 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 1073741824" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:29 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 Jul 21 19:25:29 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:29 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca316db-378c-4268-bde4-9218b2cd54c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14e6c2c-c610-47d5-8219-c9434d458523', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4934578-6c32-4901-a142-41899dacdeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Volume volume-b14e6c2c-c610-47d5-8219-c9434d458523 (b14e6c2c-c610-47d5-8219-c9434d458523): created successfully Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4934578-6c32-4901-a142-41899dacdeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (eac1549b-255b-4e79-877a-6e36e12e4c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6859ab14-0b77-421a-95f2-9bcafbaf060c tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 00487f4d-fc6c-4fbb-9c65-121ad0fc2707 of volume b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f504b33-2ea5-480e-b21e-4d05d1adcb8b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:29 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 Jul 21 19:25:29 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:30 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:30 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 1G Jul 21 19:25:30 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:30 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 1G" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14e6c2c-c610-47d5-8219-c9434d458523 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:30 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14e6c2c-c610-47d5-8219-c9434d458523 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 Jul 21 19:25:30 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:30 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14e6c2c-c610-47d5-8219-c9434d458523 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:30 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 is being set with open permissions: ugo+rw Jul 21 19:25:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:30 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 Jul 21 19:25:30 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:31 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:31 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info Jul 21 19:25:31 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:31 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:31 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info is being set with open permissions: ugo+rw Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:31 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info Jul 21 19:25:31 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:31 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.info" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f60371e8-1366-43d8-8308-79f24a049801 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-00487f4d-fc6c-4fbb-9c65-121ad0fc2707-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-00487f4d-fc6c-4fbb-9c65-121ad0fc2707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-00487f4d-fc6c-4fbb-9c65-121ad0fc2707" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-00487f4d-fc6c-4fbb-9c65-121ad0fc2707" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 00487f4d-fc6c-4fbb-9c65-121ad0fc2707 of volume b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eec283-e14b-4eeb-b0b6-c40d2cab7136]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:32 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 Jul 21 19:25:32 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:32 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b14e6c2c-c610-47d5-8219-c9434d458523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3ba0f-d669-447b-9e2a-68be007c641d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:32 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 Jul 21 19:25:32 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:32 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:32 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 Jul 21 19:25:32 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:33 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:33 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707 Jul 21 19:25:33 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:33 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523.00487f4d-fc6c-4fbb-9c65-121ad0fc2707" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-00487f4d-fc6c-4fbb-9c65-121ad0fc2707" released by "_delete_snapshot" :: held 1.368s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" released by "delete_snapshot" :: held 1.388s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Created reservations ['127ea0d0-ea8a-4702-b181-64142b923588', '3610a03a-e4a0-4b64-86c5-ef3cec819f13', '22be2caa-45b5-454b-bcbd-589e0133f339', 'c388144d-00c0-4eab-baa1-2e30255d0f02'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-25b88556-979a-423e-a6e7-77ca55002a07 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-00487f4d-fc6c-4fbb-9c65-121ad0fc2707-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-b14e6c2c-c610-47d5-8219-c9434d458523-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-b14e6c2c-c610-47d5-8219-c9434d458523-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896df2e-c7a4-46e4-9882-90acb6e1864e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:34 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 Jul 21 19:25:34 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:34 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:34 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523 Jul 21 19:25:34 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:34 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-b14e6c2c-c610-47d5-8219-c9434d458523" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-b14e6c2c-c610-47d5-8219-c9434d458523" released by "delete_volume" :: held 0.656s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Created reservations ['d4923428-98fb-4542-b0a2-9cbf5a92e26d', '01f70fa4-d8e9-46fc-9e63-13f0a98cfd80', '8bd93838-9b9d-4b82-b95c-4fb4fdf15d5d', '0056dd8b-2157-4719-94eb-76b8d3c0be2d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:34 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:34 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:35 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1fc9df8-b5d4-4d5f-8aff-f75cf4910388 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-b14e6c2c-c610-47d5-8219-c9434d458523-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (f9b298b8-baba-4408-880b-106d2a2cda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78146bb0-ebf5-4f08-b607-171f4af07d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78146bb0-ebf5-4f08-b607-171f4af07d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053032831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:36Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1601303-95b9-4d43-bbd8-6e1d6d4849e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1601303-95b9-4d43-bbd8-6e1d6d4849e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7751911c-caf1-471c-8b98-0faf7a9e7848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7751911c-caf1-471c-8b98-0faf7a9e7848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d', 'volume_name': 'volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6de493a-9021-4bd0-a243-9100d9d0e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6de493a-9021-4bd0-a243-9100d9d0e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a735e0-6986-4606-bf02-00fcfb22975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Volume 3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d', 'volume_size': 1} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053032831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:36Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Creating volume 3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:35 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d 1073741824 Jul 21 19:25:35 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:36 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d 1073741824" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:36 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d Jul 21 19:25:36 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:36 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a735e0-6986-4606-bf02-00fcfb22975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc8425-313e-4723-a2e5-db71eb0a3a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Volume volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d (3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d): created successfully Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6fc8425-313e-4723-a2e5-db71eb0a3a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (f9b298b8-baba-4408-880b-106d2a2cda7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-abb0250e-741b-4ab7-9007-209f19d7b1df tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 65e4b9b0-7019-453b-a2c8-53397f62cef6 of volume 3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58c7b2b-8d3e-4851-a764-485a2923d3c6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:36 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d Jul 21 19:25:36 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:37 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:37 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 1G Jul 21 19:25:37 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:37 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 1G" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:37 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 Jul 21 19:25:37 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:37 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:37 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 is being set with open permissions: ugo+rw Jul 21 19:25:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:37 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 Jul 21 19:25:37 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:38 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:38 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info Jul 21 19:25:38 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:38 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info is being set with open permissions: ugo+rw Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:38 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info Jul 21 19:25:38 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:38 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399c84a9-2899-4a97-899f-b6a75e0a713c tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-65e4b9b0-7019-453b-a2c8-53397f62cef6-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-65e4b9b0-7019-453b-a2c8-53397f62cef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-65e4b9b0-7019-453b-a2c8-53397f62cef6" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-65e4b9b0-7019-453b-a2c8-53397f62cef6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 65e4b9b0-7019-453b-a2c8-53397f62cef6 of volume 3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac000c-4656-4559-965a-8e92431d6fa8]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:39 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 Jul 21 19:25:39 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:39 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[808751d9-5123-4e86-bf66-d428ce70be4e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:39 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d Jul 21 19:25:39 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:39 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:39 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 Jul 21 19:25:39 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:40 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:40 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6 Jul 21 19:25:40 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:40 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d.65e4b9b0-7019-453b-a2c8-53397f62cef6" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-65e4b9b0-7019-453b-a2c8-53397f62cef6" released by "_delete_snapshot" :: held 1.349s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" released by "delete_snapshot" :: held 1.371s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Created reservations ['20314172-e09f-435d-8476-e5b7a6a523e2', '5f4dfd2e-19a8-4275-9c98-16ffbcd6f5ed', '89d6746a-0ec5-41b2-96eb-4bf6e8b6fa32', '9a4e5da1-c66c-4317-8c59-43d520735ad9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-88bd0942-5de8-4d62-aef3-0c985da5bfac tempest-ProjectMemberTests-1718051275 None] Lock "cinder-65e4b9b0-7019-453b-a2c8-53397f62cef6-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e117181-03b2-48a9-a663-87dbd0cf16dd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:41 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d Jul 21 19:25:41 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:41 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:41 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d Jul 21 19:25:41 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:41 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d" released by "delete_volume" :: held 0.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Created reservations ['aee5d5c6-922b-47c8-b402-cc71fadfa806', '2c23cfd0-33f3-4878-8647-a6ee77ae1ef0', 'b8fc8927-a425-49ea-8995-d0850b2992c2', '70e20af8-4603-4271-8ec8-960bbeca1aee'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:41 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:41 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:42 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=182,cinder:UPDATE=225,cinder:INSERT=61,cinder:DELETE=23 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-255a8ca2-3f01-4d68-927d-a8fc5ac2737d tempest-ProjectMemberTests-1718051275 None] Lock "cinder-3cc4f9d0-9da0-4ae2-b3bb-05944d3bac1d-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=168,cinder:UPDATE=246,cinder:INSERT=63,cinder:DELETE=17 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (82a25195-3e3c-4835-861a-f3cb33b67951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9cc500-f1b2-4df4-a773-510f19008098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9cc500-f1b2-4df4-a773-510f19008098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286008694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9754fedf-8fa7-4853-9dde-3e50349973af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:43Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e9be6a-e08d-482a-ac07-634f8f76197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e9be6a-e08d-482a-ac07-634f8f76197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fd8b4b-fefa-46a0-a24c-dacd62483e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fd8b4b-fefa-46a0-a24c-dacd62483e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9754fedf-8fa7-4853-9dde-3e50349973af', 'volume_name': 'volume-9754fedf-8fa7-4853-9dde-3e50349973af', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5211b410-6c4b-4479-8aa3-0927c0ad827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5211b410-6c4b-4479-8aa3-0927c0ad827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb290b-58f9-4231-852c-3cd91e20d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Volume 9754fedf-8fa7-4853-9dde-3e50349973af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9754fedf-8fa7-4853-9dde-3e50349973af', 'volume_size': 1} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286008694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9754fedf-8fa7-4853-9dde-3e50349973af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddaa601495241ccb2bf9ea9701123f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:43Z,use_quota=True,user_id='8764532d82084a0385da0c3fde4c52e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Creating volume 9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:42 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af 1073741824 Jul 21 19:25:42 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:43 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af 1073741824" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:43 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af Jul 21 19:25:43 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:43 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbb290b-58f9-4231-852c-3cd91e20d32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9754fedf-8fa7-4853-9dde-3e50349973af', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b75cef6-9525-46fe-9e16-7fed2e5c6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Volume volume-9754fedf-8fa7-4853-9dde-3e50349973af (9754fedf-8fa7-4853-9dde-3e50349973af): created successfully Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b75cef6-9525-46fe-9e16-7fed2e5c6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Flow 'volume_create_manager' (82a25195-3e3c-4835-861a-f3cb33b67951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-69b21210-1f1f-43d8-b8a6-a6c4b7041094 tempest-ProjectMemberTests-1718051275 None] Created volume successfully. Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Creating offline snapshot 075c9796-b8e3-423f-a2f5-54b9a4bb60bd of volume 9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b418c5e-9640-49dc-9e2b-7ae83d32136b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:43 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af Jul 21 19:25:43 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:44 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:44 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd 1G Jul 21 19:25:44 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:44 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd 1G" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9754fedf-8fa7-4853-9dde-3e50349973af -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:44 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9754fedf-8fa7-4853-9dde-3e50349973af -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd Jul 21 19:25:44 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:44 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9754fedf-8fa7-4853-9dde-3e50349973af -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd is being set with open permissions: ugo+rw Jul 21 19:25:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:44 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd Jul 21 19:25:44 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:45 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:45 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info Jul 21 19:25:45 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:45 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:45 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info is being set with open permissions: ugo+rw Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:45 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info Jul 21 19:25:45 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:45 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.info" returned: 0 in 0.228s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b4538cf3-df00-4a1d-8807-4eabcf056a84 tempest-ProjectMemberTests-1718051275 None] Create snapshot completed successfully Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-075c9796-b8e3-423f-a2f5-54b9a4bb60bd-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-075c9796-b8e3-423f-a2f5-54b9a4bb60bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-075c9796-b8e3-423f-a2f5-54b9a4bb60bd" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-075c9796-b8e3-423f-a2f5-54b9a4bb60bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Deleting offline snapshot 075c9796-b8e3-423f-a2f5-54b9a4bb60bd of volume 9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] snapshot_file for this snap is: volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da62d1d8-8251-4f38-bc2b-ae8b0ab3ab4d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:46 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd Jul 21 19:25:46 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:46 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9754fedf-8fa7-4853-9dde-3e50349973af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f5bdc1-7200-4882-8c07-5eb173bac651]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:46 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af Jul 21 19:25:46 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:46 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:46 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd Jul 21 19:25:46 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:47 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:47 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd Jul 21 19:25:47 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:47 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af.075c9796-b8e3-423f-a2f5-54b9a4bb60bd" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-075c9796-b8e3-423f-a2f5-54b9a4bb60bd" released by "_delete_snapshot" :: held 1.363s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" released by "delete_snapshot" :: held 1.387s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Created reservations ['8feacf68-2ff6-453c-845e-f15f25c0cbc2', '15c5de92-2adf-40c0-9de6-7e091ce7fc31', 'a2bafd02-2ebf-420d-95da-8014befd86e4', '04d3de79-7875-43cc-92a4-d4bcc9ca692f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Delete snapshot completed successfully. Jul 21 19:25:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-850893bb-3109-4577-a5e4-fc38050de544 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-075c9796-b8e3-423f-a2f5-54b9a4bb60bd-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-9754fedf-8fa7-4853-9dde-3e50349973af-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-9754fedf-8fa7-4853-9dde-3e50349973af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f1eec9-7213-462c-bc7c-2b017ea12cc9]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:48 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af Jul 21 19:25:48 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:48 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:48 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af Jul 21 19:25:48 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:48 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-9754fedf-8fa7-4853-9dde-3e50349973af" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-quobyte-9754fedf-8fa7-4853-9dde-3e50349973af" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Created reservations ['16ad1dce-3440-4b22-b9e4-e51c24924d4f', 'dd9b7af8-e130-4cb3-9e53-8c4a94e922bb', 'bcd2ac0d-8ce3-47eb-b7ee-c22aefc2390b', '9be2a4fa-9b20-463a-a218-383a7e62c275'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:49 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:49 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:49 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Deleted volume successfully. Jul 21 19:25:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab3a8b93-7aa8-4deb-8372-0a6c75e9b4c7 tempest-ProjectMemberTests-1718051275 None] Lock "cinder-9754fedf-8fa7-4853-9dde-3e50349973af-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (74612dd0-70c1-49bb-963f-fbad8e271c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f475a2-5ce0-420c-a4b9-41300b586142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f475a2-5ce0-420c-a4b9-41300b586142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791883459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:53Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e9ad5e-e0f2-443a-ae4e-3875c622f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e9ad5e-e0f2-443a-ae4e-3875c622f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a75c93-5c9d-45b4-838c-4d8965c60faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a75c93-5c9d-45b4-838c-4d8965c60faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88', 'volume_name': 'volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e9ab2-a8f9-4241-a06e-11dfa0c3c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e9ab2-a8f9-4241-a06e-11dfa0c3c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be86906c-1cd5-4d6c-b92e-55b7ab7bcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Volume 1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88', 'volume_size': 1} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791883459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:25:53Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Creating volume 1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:25:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:53 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 1073741824 Jul 21 19:25:53 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:53 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 1073741824" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:53 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 Jul 21 19:25:53 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:53 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be86906c-1cd5-4d6c-b92e-55b7ab7bcb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f03a593-b454-4a3a-99b6-fa7d0ef1107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:25:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Volume volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 (1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88): created successfully Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f03a593-b454-4a3a-99b6-fa7d0ef1107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:25:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (74612dd0-70c1-49bb-963f-fbad8e271c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:25:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-95cd10db-2449-4042-9b44-bdc0225709eb tempest-ProjectReaderTests-1917158543 None] Created volume successfully. Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Creating offline snapshot dd270a5b-a724-4a0d-95d0-0918b3a1b50c of volume 1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aacc1c-9ad7-4c1a-845e-8c79cc5dd3cd]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:54 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 Jul 21 19:25:54 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:54 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:54 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c 1G Jul 21 19:25:54 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:54 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c 1G" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:54 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c Jul 21 19:25:54 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:55 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c is being set with open permissions: ugo+rw Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:55 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c Jul 21 19:25:55 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:55 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:55 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info Jul 21 19:25:55 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:55 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info is being set with open permissions: ugo+rw Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:55 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info Jul 21 19:25:55 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:55 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.info" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0bdb5afb-4aeb-495d-831e-b7a51537a705 tempest-ProjectReaderTests-1917158543 None] Create snapshot completed successfully Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-dd270a5b-a724-4a0d-95d0-0918b3a1b50c-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-dd270a5b-a724-4a0d-95d0-0918b3a1b50c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-dd270a5b-a724-4a0d-95d0-0918b3a1b50c" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-dd270a5b-a724-4a0d-95d0-0918b3a1b50c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Deleting offline snapshot dd270a5b-a724-4a0d-95d0-0918b3a1b50c of volume 1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] snapshot_file for this snap is: volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce74cdd-5d52-4a30-8134-8c6f11dc8f6a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:56 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c Jul 21 19:25:56 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:56 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285c632-c8ae-4939-bed0-d8821e0b7564]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:56 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 Jul 21 19:25:56 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:57 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:57 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c Jul 21 19:25:57 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:57 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:57 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c Jul 21 19:25:57 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:57 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88.dd270a5b-a724-4a0d-95d0-0918b3a1b50c" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-dd270a5b-a724-4a0d-95d0-0918b3a1b50c" released by "_delete_snapshot" :: held 1.362s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" released by "delete_snapshot" :: held 1.384s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Created reservations ['4d7e5d52-39d2-408d-b7ef-50074a0ab842', '87470f8f-654f-46d3-b898-af4a6ee6184a', 'c7bcbba9-3f0d-41f8-a294-7578d9a43d57', 'a1c11a53-0775-4257-842f-712b06cda10f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Delete snapshot completed successfully. Jul 21 19:25:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-620235e3-1d48-4138-99d9-71ba71c64a61 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-dd270a5b-a724-4a0d-95d0-0918b3a1b50c-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bae0b6-56b3-401a-8b76-767d17b50c17]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:58 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 Jul 21 19:25:58 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:58 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:58 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88 Jul 21 19:25:58 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:59 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Created reservations ['232896c8-0bde-43d5-8fbc-3c1d7d1b4afe', '9c3c8cb3-ceca-49cf-a7da-d3a2008fcd2d', 'b0e851be-c88a-438e-99d5-efd28a76fbba', '0c8bdf6e-3bd2-4ad6-b054-7dc728fdbc46'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:25:59 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:25:59 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:25:59 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:25:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Deleted volume successfully. Jul 21 19:25:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3b359342-5fad-4136-b7f5-f64c544ee66e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-1b34c4ad-e97f-4ff4-a3b6-bc8ac04d1a88-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (0f691dc7-8325-4295-9ae3-c7f72d02c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a11afb-b367-4788-942e-8f22d7acd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a11afb-b367-4788-942e-8f22d7acd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620229152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d0d772-61b9-40ec-8a82-198630b954fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:00Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c24b0ca-b7f6-49a1-a6b5-395c05aeec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c24b0ca-b7f6-49a1-a6b5-395c05aeec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591e2f6a-5cd4-413e-be7c-3d19afffd310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591e2f6a-5cd4-413e-be7c-3d19afffd310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d0d772-61b9-40ec-8a82-198630b954fc', 'volume_name': 'volume-98d0d772-61b9-40ec-8a82-198630b954fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b6c79-aa3a-4d80-8a3d-90ab438d9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b6c79-aa3a-4d80-8a3d-90ab438d9da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e656f-5f0d-4708-9cf2-dc05111528cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Volume 98d0d772-61b9-40ec-8a82-198630b954fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d0d772-61b9-40ec-8a82-198630b954fc', 'volume_size': 1} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620229152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d0d772-61b9-40ec-8a82-198630b954fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:00Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Creating volume 98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:26:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:00 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc 1073741824 Jul 21 19:26:00 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:00 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc 1073741824" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:00 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc Jul 21 19:26:00 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:00 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e656f-5f0d-4708-9cf2-dc05111528cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d0d772-61b9-40ec-8a82-198630b954fc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf839a55-2a70-415b-8e82-0b8ea5c19b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Volume volume-98d0d772-61b9-40ec-8a82-198630b954fc (98d0d772-61b9-40ec-8a82-198630b954fc): created successfully Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf839a55-2a70-415b-8e82-0b8ea5c19b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (0f691dc7-8325-4295-9ae3-c7f72d02c11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-858e6ba2-97b8-4427-b673-4664e87b1534 tempest-ProjectReaderTests-1917158543 None] Created volume successfully. Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Creating offline snapshot 3bf36af9-37bf-4c23-b68a-8a1bf0576475 of volume 98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c5f11b-b98e-4e7a-adce-0a2a7d7ce07a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:01 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc Jul 21 19:26:01 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:01 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:01 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 1G Jul 21 19:26:01 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:01 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 1G" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d772-61b9-40ec-8a82-198630b954fc -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:02 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d772-61b9-40ec-8a82-198630b954fc -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 Jul 21 19:26:02 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:02 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98d0d772-61b9-40ec-8a82-198630b954fc -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 is being set with open permissions: ugo+rw Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:02 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 Jul 21 19:26:02 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:02 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:02 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info Jul 21 19:26:02 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:02 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info is being set with open permissions: ugo+rw Jul 21 19:26:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:02 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info Jul 21 19:26:02 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:03 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.info" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c2065c3d-9946-4e46-aa54-b37bd1f8dc20 tempest-ProjectReaderTests-1917158543 None] Create snapshot completed successfully Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-3bf36af9-37bf-4c23-b68a-8a1bf0576475-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-3bf36af9-37bf-4c23-b68a-8a1bf0576475-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-3bf36af9-37bf-4c23-b68a-8a1bf0576475" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-3bf36af9-37bf-4c23-b68a-8a1bf0576475" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Deleting offline snapshot 3bf36af9-37bf-4c23-b68a-8a1bf0576475 of volume 98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] snapshot_file for this snap is: volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3033f33c-f3f4-43b6-af27-416de58e4ef2]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:03 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 Jul 21 19:26:03 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:03 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98d0d772-61b9-40ec-8a82-198630b954fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb78dbe9-1586-44dc-9dec-ba1834500a2c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:03 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc Jul 21 19:26:03 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:04 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:04 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 Jul 21 19:26:04 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:04 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:04 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475 Jul 21 19:26:04 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:04 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc.3bf36af9-37bf-4c23-b68a-8a1bf0576475" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-3bf36af9-37bf-4c23-b68a-8a1bf0576475" released by "_delete_snapshot" :: held 1.357s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" released by "delete_snapshot" :: held 1.381s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Created reservations ['ad7b32fd-a2b1-4108-babe-77d5e7af0e53', 'bd041ae2-5853-4166-975a-7b7d79578e96', '27c145b2-d206-4581-9e1c-0f59d7cd3bbc', '633f9c32-72ca-4eea-a62d-6c511a2381f7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Delete snapshot completed successfully. Jul 21 19:26:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-064516b2-a1ca-4160-8e89-1620a0c991a7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-3bf36af9-37bf-4c23-b68a-8a1bf0576475-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-98d0d772-61b9-40ec-8a82-198630b954fc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-98d0d772-61b9-40ec-8a82-198630b954fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330b749-1e60-459a-9add-2a83338443b3]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:05 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc Jul 21 19:26:05 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:05 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:05 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc Jul 21 19:26:05 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:06 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-98d0d772-61b9-40ec-8a82-198630b954fc" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-98d0d772-61b9-40ec-8a82-198630b954fc" released by "delete_volume" :: held 0.633s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Created reservations ['b99e62fb-43ca-4418-933a-0c9531223ca8', '16ef8e45-be5f-41b9-90cf-aa3b04e03131', '444f4c4b-7c6d-4b21-a52d-10265c989a6a', 'cb4dfe6e-246c-40f6-848d-47b6f79d03f9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:06 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:26:06 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:06 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:26:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Deleted volume successfully. Jul 21 19:26:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05921b27-ae5b-4854-9f5c-9a492ae1257e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-98d0d772-61b9-40ec-8a82-198630b954fc-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c093e786-1e18-468b-af0c-03c08dcceb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d18a103-a16c-42ae-b501-2757af9d4c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d18a103-a16c-42ae-b501-2757af9d4c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979843092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547c6a0-5a51-49cd-8a51-1551b35ac7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:07Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79e6190-616d-4e84-af49-65256be7f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79e6190-616d-4e84-af49-65256be7f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a84939b-acbc-4810-af9c-925cc5e171d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a84939b-acbc-4810-af9c-925cc5e171d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1547c6a0-5a51-49cd-8a51-1551b35ac7b6', 'volume_name': 'volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a1a9d4-eeaf-423a-8abc-37f7fa625fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a1a9d4-eeaf-423a-8abc-37f7fa625fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ec383-e73e-4030-b602-c37e270a28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Volume 1547c6a0-5a51-49cd-8a51-1551b35ac7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6', 'volume_size': 1} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979843092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1547c6a0-5a51-49cd-8a51-1551b35ac7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:07Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Creating volume 1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:26:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:07 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 1073741824 Jul 21 19:26:07 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:07 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 1073741824" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:07 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 Jul 21 19:26:07 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:07 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ec383-e73e-4030-b602-c37e270a28ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f15a71-ffb0-4020-9a29-00e1509722f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Volume volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 (1547c6a0-5a51-49cd-8a51-1551b35ac7b6): created successfully Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f15a71-ffb0-4020-9a29-00e1509722f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c093e786-1e18-468b-af0c-03c08dcceb91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-be8a61be-1ce0-4d30-9d9b-290f60b7668f tempest-ProjectReaderTests-1917158543 None] Created volume successfully. Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Creating offline snapshot 72a6d2a1-5801-45eb-9baa-f4ea3980665c of volume 1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614c0d5-7901-46a0-a492-12d693c18dc7]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:08 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 Jul 21 19:26:08 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:08 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:08 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c 1G Jul 21 19:26:08 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:08 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c 1G" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:09 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c Jul 21 19:26:09 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:09 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c is being set with open permissions: ugo+rw Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:09 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c Jul 21 19:26:09 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:09 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:09 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info Jul 21 19:26:09 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:09 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info is being set with open permissions: ugo+rw Jul 21 19:26:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:09 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info Jul 21 19:26:09 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:10 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.info" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2685e6e9-df0d-4d58-9934-bbbf71152f54 tempest-ProjectReaderTests-1917158543 None] Create snapshot completed successfully Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-72a6d2a1-5801-45eb-9baa-f4ea3980665c-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-72a6d2a1-5801-45eb-9baa-f4ea3980665c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-72a6d2a1-5801-45eb-9baa-f4ea3980665c" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-72a6d2a1-5801-45eb-9baa-f4ea3980665c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Deleting offline snapshot 72a6d2a1-5801-45eb-9baa-f4ea3980665c of volume 1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] snapshot_file for this snap is: volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d99d738-188f-4e9a-97b3-dfe2863b547e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:10 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c Jul 21 19:26:10 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:10 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3912b0be-c192-4475-9156-9ea04319e175]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:10 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 Jul 21 19:26:10 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:11 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:11 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c Jul 21 19:26:11 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:11 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:11 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c Jul 21 19:26:11 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:11 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6.72a6d2a1-5801-45eb-9baa-f4ea3980665c" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-72a6d2a1-5801-45eb-9baa-f4ea3980665c" released by "_delete_snapshot" :: held 1.323s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" released by "delete_snapshot" :: held 1.342s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Created reservations ['e9dbd182-74fa-4f08-95b2-fedc126a9c7f', '836c8495-bd84-4442-af18-b88830bfc224', 'e569b330-ad81-42f9-91bc-db58ac340f4e', '014fe9e1-d29c-4ddf-a795-9e6cadf758d9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Delete snapshot completed successfully. Jul 21 19:26:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7605d50-ef21-415a-bba8-3b33527362e1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-72a6d2a1-5801-45eb-9baa-f4ea3980665c-delete_snapshot" released by "delete_snapshot" :: held 1.467s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-1547c6a0-5a51-49cd-8a51-1551b35ac7b6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-1547c6a0-5a51-49cd-8a51-1551b35ac7b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c98505-27f1-493a-a7e4-313074de1d64]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:12 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 Jul 21 19:26:12 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:12 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:12 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6 Jul 21 19:26:12 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:13 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-1547c6a0-5a51-49cd-8a51-1551b35ac7b6" released by "delete_volume" :: held 0.620s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Created reservations ['8c7c5922-c36a-40e1-b527-c37d3d1be15b', '2dd3db60-aacd-4e80-8b87-764b0c0d84b0', '6a6921e0-3e6d-4510-be7b-0ff2c612e00c', '209ff34f-b65a-436c-87ec-a1dee8b421f2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:13 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:26:13 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:13 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:26:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Deleted volume successfully. Jul 21 19:26:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d6dc2449-43c1-4cc9-ab38-b0062993daa7 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-1547c6a0-5a51-49cd-8a51-1551b35ac7b6-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c30c4c1a-d953-4f9d-acb6-05732a25083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9f5431-5977-436e-8cb5-9b0267f1b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9f5431-5977-436e-8cb5-9b0267f1b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033530336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41726f3-957f-4bf4-a3bb-6f5b385339e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:14Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a67d63-001a-4cc7-b70d-364419d4a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a67d63-001a-4cc7-b70d-364419d4a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4333d957-5fcc-481c-8c81-3884f3836a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4333d957-5fcc-481c-8c81-3884f3836a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41726f3-957f-4bf4-a3bb-6f5b385339e0', 'volume_name': 'volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8a3159-e3a9-46ec-b5d3-ea6a95053806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8a3159-e3a9-46ec-b5d3-ea6a95053806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25028c4b-6bb0-45ee-909c-fafd998569b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Volume f41726f3-957f-4bf4-a3bb-6f5b385339e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0', 'volume_size': 1} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033530336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41726f3-957f-4bf4-a3bb-6f5b385339e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:14Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Creating volume f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:26:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:14 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 1073741824 Jul 21 19:26:14 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:14 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 1073741824" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:14 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 Jul 21 19:26:14 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:14 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25028c4b-6bb0-45ee-909c-fafd998569b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a3ae84-1666-4047-8a9c-1bd3f1b911e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Volume volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 (f41726f3-957f-4bf4-a3bb-6f5b385339e0): created successfully Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a3ae84-1666-4047-8a9c-1bd3f1b911e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c30c4c1a-d953-4f9d-acb6-05732a25083b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a7ffb8ce-89ff-4ecf-9f51-624ffca7805d tempest-ProjectReaderTests-1917158543 None] Created volume successfully. Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Creating offline snapshot 37f6b2af-1e6c-4030-921c-e288a9c56017 of volume f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab7383-d10d-41ec-a355-6235d0b48b3d]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:15 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 Jul 21 19:26:15 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:15 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:15 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 1G Jul 21 19:26:15 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:15 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 1G" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:15 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 Jul 21 19:26:15 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:16 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:16 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 is being set with open permissions: ugo+rw Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:16 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 Jul 21 19:26:16 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:16 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:16 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info Jul 21 19:26:16 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:16 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:16 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info is being set with open permissions: ugo+rw Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:16 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info Jul 21 19:26:16 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:16 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.info" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbd5a985-d659-4a0b-9c81-89ed64f412fa tempest-ProjectReaderTests-1917158543 None] Create snapshot completed successfully Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-37f6b2af-1e6c-4030-921c-e288a9c56017-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-37f6b2af-1e6c-4030-921c-e288a9c56017-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-37f6b2af-1e6c-4030-921c-e288a9c56017" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-37f6b2af-1e6c-4030-921c-e288a9c56017" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Deleting offline snapshot 37f6b2af-1e6c-4030-921c-e288a9c56017 of volume f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] snapshot_file for this snap is: volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[46945fcc-7448-42c0-975c-787487f57c41]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:17 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 Jul 21 19:26:17 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:17 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[386bdea2-94d9-403f-a039-8d7bff075097]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:17 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 Jul 21 19:26:17 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:18 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:18 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 Jul 21 19:26:18 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:18 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:18 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017 Jul 21 19:26:18 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:18 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0.37f6b2af-1e6c-4030-921c-e288a9c56017" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-37f6b2af-1e6c-4030-921c-e288a9c56017" released by "_delete_snapshot" :: held 1.308s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" released by "delete_snapshot" :: held 1.329s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Created reservations ['2551da4b-2196-4995-8745-ea25bc5b9d48', '2cd72157-a6d7-4afa-8580-94625ad78c7f', '28260cfc-9683-465d-8470-49602a12c453', 'ae0789d0-82d1-42e8-97d1-b0755c573776'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Delete snapshot completed successfully. Jul 21 19:26:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cc7f2d3-7390-401f-9bd6-131c34209d5f tempest-ProjectReaderTests-1917158543 None] Lock "cinder-37f6b2af-1e6c-4030-921c-e288a9c56017-delete_snapshot" released by "delete_snapshot" :: held 1.447s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-f41726f3-957f-4bf4-a3bb-6f5b385339e0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "cinder-f41726f3-957f-4bf4-a3bb-6f5b385339e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b671ce-71e5-4477-810b-57dce5251bf6]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:19 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 Jul 21 19:26:19 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:19 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:19 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0 Jul 21 19:26:19 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:20 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-f41726f3-957f-4bf4-a3bb-6f5b385339e0" returned: 0 in 0.228s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-f41726f3-957f-4bf4-a3bb-6f5b385339e0" released by "delete_volume" :: held 0.627s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Created reservations ['853799e6-fd1f-4ceb-b87e-14bcf411d301', 'c3fb32fc-67c5-48e3-91b0-46f30631fee4', '6adcff97-0605-44b2-940d-a012f3b3db95', 'ff68214c-b2c2-4079-9211-15791df3bfed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:20 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:26:20 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:20 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:26:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Deleted volume successfully. Jul 21 19:26:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0db4862-8a22-41be-afef-4fa3839d9ade tempest-ProjectReaderTests-1917158543 None] Lock "cinder-f41726f3-957f-4bf4-a3bb-6f5b385339e0-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c7083936-68b7-4fd9-a123-b2a110d464b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801eee88-fae1-4a2a-84b5-3e23a2e46a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801eee88-fae1-4a2a-84b5-3e23a2e46a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120106515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccd9176-fc0f-480c-acf0-3deaf2eb8c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:21Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd615f1-a3c0-4c6e-9f0d-1e59d02261cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd615f1-a3c0-4c6e-9f0d-1e59d02261cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bce60a-f9a8-47ec-b009-04074dbbac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bce60a-f9a8-47ec-b009-04074dbbac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccd9176-fc0f-480c-acf0-3deaf2eb8c24', 'volume_name': 'volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae5cee9-81f4-40df-bfa9-c51fa790c9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae5cee9-81f4-40df-bfa9-c51fa790c9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2356215-4099-4873-a07d-605e2e1acc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Volume 6ccd9176-fc0f-480c-acf0-3deaf2eb8c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24', 'volume_size': 1} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120106515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccd9176-fc0f-480c-acf0-3deaf2eb8c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838e3e5710df4e1f8a5b68d182e46ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:21Z,use_quota=True,user_id='e254f08ec59c480c802d0db97f0c7c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Creating volume 6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:26:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:21 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 1073741824 Jul 21 19:26:21 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:21 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 1073741824" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:21 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 Jul 21 19:26:21 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:21 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2356215-4099-4873-a07d-605e2e1acc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d94c58c-776b-454a-a3c5-55dd9abff7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Volume volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 (6ccd9176-fc0f-480c-acf0-3deaf2eb8c24): created successfully Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d94c58c-776b-454a-a3c5-55dd9abff7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Flow 'volume_create_manager' (c7083936-68b7-4fd9-a123-b2a110d464b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-974c84cf-400d-412a-a011-86b7140fb887 tempest-ProjectReaderTests-1917158543 None] Created volume successfully. Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Creating offline snapshot 7318438d-2443-4764-9b8c-c86223689849 of volume 6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbffdf1e-a4b8-405d-a8df-a668a0f2fc35]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:22 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 Jul 21 19:26:22 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:22 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:22 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 1G Jul 21 19:26:22 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:22 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 1G" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:23 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 Jul 21 19:26:23 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:23 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 is being set with open permissions: ugo+rw Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:23 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 Jul 21 19:26:23 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:23 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:23 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info Jul 21 19:26:23 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:23 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info is being set with open permissions: ugo+rw Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:23 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info Jul 21 19:26:23 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:23 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d5d1f7f2-0c2d-4d16-9987-29c44a21e453 tempest-ProjectReaderTests-1917158543 None] Create snapshot completed successfully Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-7318438d-2443-4764-9b8c-c86223689849-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-7318438d-2443-4764-9b8c-c86223689849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-7318438d-2443-4764-9b8c-c86223689849" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-7318438d-2443-4764-9b8c-c86223689849" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Deleting offline snapshot 7318438d-2443-4764-9b8c-c86223689849 of volume 6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] snapshot_file for this snap is: volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d3fcf-4caa-43d7-84c6-c172ba212609]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:24 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 Jul 21 19:26:24 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:24 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9aa29-d200-4c6e-8cb8-0d19797b4e6b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:24 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 Jul 21 19:26:24 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:25 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:25 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 Jul 21 19:26:25 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:25 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:25 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849 Jul 21 19:26:25 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:25 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24.7318438d-2443-4764-9b8c-c86223689849" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-7318438d-2443-4764-9b8c-c86223689849" released by "_delete_snapshot" :: held 1.317s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" released by "delete_snapshot" :: held 1.338s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:25 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:26:25 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Created reservations ['cf8ba2d5-cbc3-4f39-8304-472cb5fb1735', '7dff3c19-82d4-4afc-a3e8-54f0945dee85', 'af6e29ea-58d8-442c-bc6f-3549fa1a3500', '3b2f3ff0-54fd-4e88-a3bb-836f9cbdbf60'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Delete snapshot completed successfully. Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a7540bc9-162f-41a1-bac0-59a9cca28c5e tempest-ProjectReaderTests-1917158543 None] Lock "cinder-7318438d-2443-4764-9b8c-c86223689849-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:25 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:26:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e8a414-93d6-4d1f-aba0-b7a7fbe54a4a]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:26 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 Jul 21 19:26:26 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:26 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:26 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24 Jul 21 19:26:26 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:27 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-quobyte-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24" released by "delete_volume" :: held 0.630s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Created reservations ['588b86c2-610b-4982-a4c4-ee1dcd795f20', '8648c09b-5583-48d8-826c-e718ddc152fa', 'f6d37659-1cd7-4f00-be38-c7b31b837adb', '051fe7c0-8b5e-41d8-bb0e-5a4c1f49259f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:27 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:26:27 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:27 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:26:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Deleted volume successfully. Jul 21 19:26:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3458920d-ec0c-4724-9c38-019b30b58ba1 tempest-ProjectReaderTests-1917158543 None] Lock "cinder-6ccd9176-fc0f-480c-acf0-3deaf2eb8c24-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:26:37 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=86,cinder:UPDATE=108,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:26:37 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=83,cinder:UPDATE=108,cinder:INSERT=38,cinder:DELETE=12 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Flow 'volume_create_manager' (baf11853-124d-40e5-9939-d0fbbadfc560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9715b05f-ace2-4375-bdd5-4c07e8f05de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9715b05f-ace2-4375-bdd5-4c07e8f05de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-98713957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ed0e2-31b4-43d7-acc1-a66f07b55ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b37932736db4f2884ece3bc6d594367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:57Z,use_quota=True,user_id='d4cdf8d709644855a6c3f5255c6f9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97c9ec5-9968-4a09-b2f3-132d5f720137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97c9ec5-9968-4a09-b2f3-132d5f720137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955111b0-c766-44b0-82e6-25ffa9d54a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955111b0-c766-44b0-82e6-25ffa9d54a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149ed0e2-31b4-43d7-acc1-a66f07b55ec3', 'volume_name': 'volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8dfcc8-27ec-45f0-916a-c956cc60c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8dfcc8-27ec-45f0-916a-c956cc60c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a6c6c2-1231-43c0-862c-1a65254dc1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Volume 149ed0e2-31b4-43d7-acc1-a66f07b55ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3', 'volume_size': 1} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-98713957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ed0e2-31b4-43d7-acc1-a66f07b55ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b37932736db4f2884ece3bc6d594367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:26:57Z,use_quota=True,user_id='d4cdf8d709644855a6c3f5255c6f9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Creating volume 149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:26:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] casted to osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:57 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 1073741824 Jul 21 19:26:57 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:57 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 1073741824" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:57 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:26:57 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:58 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a6c6c2-1231-43c0-862c-1a65254dc1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a46fa1-9131-4df4-aff5-3e3d3a8b7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:26:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Volume volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 (149ed0e2-31b4-43d7-acc1-a66f07b55ec3): created successfully Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a46fa1-9131-4df4-aff5-3e3d3a8b7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Flow 'volume_create_manager' (baf11853-124d-40e5-9939-d0fbbadfc560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:26:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c57d40f3-97c8-4ac5-a35c-9dbb20d6c1be tempest-SnapshotDependencyTests-773078041 None] Created volume successfully. Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Creating offline snapshot ddedd9eb-bef0-4867-b970-8c5be6dd6f9a of volume 149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[952cfb29-9827-457f-b30e-8e84de48a86e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:58 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:26:58 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:58 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:58 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a 1G Jul 21 19:26:58 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:59 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a 1G" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:59 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:26:59 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:59 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 -F qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a is being set with open permissions: ugo+rw Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:59 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:26:59 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:26:59 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.226s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:26:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:26:59 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info Jul 21 19:26:59 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:00 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info is being set with open permissions: ugo+rw Jul 21 19:27:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:00 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info Jul 21 19:27:00 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:00 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.info" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a3848894-5273-48ad-bd8a-da44a6e8e4d9 tempest-SnapshotDependencyTests-773078041 None] Create snapshot completed successfully Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Flow 'volume_create_manager' (aac027ec-3846-4c4e-a23b-95e316ce6379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd30e2-3da7-4a44-8aac-8fa8453c8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd30e2-3da7-4a44-8aac-8fa8453c8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T17:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b7fabf-73bb-42bc-8f2d-09dc84c83b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b37932736db4f2884ece3bc6d594367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T17:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ddedd9eb-bef0-4867-b970-8c5be6dd6f9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T17:27:01Z,use_quota=True,user_id='d4cdf8d709644855a6c3f5255c6f9289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f58fc4da-eb18-40f2-ab53-1872ddea8872),volume_type_id=f58fc4da-eb18-40f2-ab53-1872ddea8872)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef4ffe1-1f9d-4657-8f77-c9e8b6eb6abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef4ffe1-1f9d-4657-8f77-c9e8b6eb6abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99411ada-6792-4c35-a906-c2849ab86e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99411ada-6792-4c35-a906-c2849ab86e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08b7fabf-73bb-42bc-8f2d-09dc84c83b0d', 'volume_name': 'volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d', 'volume_size': 1, 'snapshot_id': 'ddedd9eb-bef0-4867-b970-8c5be6dd6f9a'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49d6fb-be98-4498-815a-5e004cf99e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49d6fb-be98-4498-815a-5e004cf99e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac3165-13d4-4a77-9a8f-fb6e4bfcc004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Volume 08b7fabf-73bb-42bc-8f2d-09dc84c83b0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d', 'volume_size': 1, 'snapshot_id': 'ddedd9eb-bef0-4867-b970-8c5be6dd6f9a'} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Creating volume 08b7fabf-73bb-42bc-8f2d-09dc84c83b0d from snapshot ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Selected osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] snapshot: ddedd9eb-bef0-4867-b970-8c5be6dd6f9a, volume: 08b7fabf-73bb-42bc-8f2d-09dc84c83b0d, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68edb35-3e95-442f-a11f-478a210a065b]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:01 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:27:01 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:01 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b4a225-5630-4aab-9707-bf12eb5821ff]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:01 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:27:01 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:02 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:02 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Path /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 19:27:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:02 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d Jul 21 19:27:02 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:05 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" returned: 0 in 3.928s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d05b33-c5c0-4a4d-bf84-7b5ec51cff3e]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:06 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:27:06 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:06 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Image conversion details: src /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 19:27:06 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Converted 1024.00 MB image at 260.62 MB/s Jul 21 19:27:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d is being set with open permissions: ugo+rw Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:06 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d Jul 21 19:27:06 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:06 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" released by "_copy_volume_from_snapshot" :: held 5.485s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" released by "_create_volume_from_snapshot" :: held 5.514s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.527s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac3165-13d4-4a77-9a8f-fb6e4bfcc004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d', 'volume_size': 1, 'snapshot_id': 'ddedd9eb-bef0-4867-b970-8c5be6dd6f9a'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e68860-c048-44a0-8cf0-757a8c59c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 19:27:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Volume volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d (08b7fabf-73bb-42bc-8f2d-09dc84c83b0d): created successfully Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e68860-c048-44a0-8cf0-757a8c59c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 19:27:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Flow 'volume_create_manager' (aac027ec-3846-4c4e-a23b-95e316ce6379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 19:27:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eba4ceea-346f-4ba7-8d11-eb7a1aa254e8 tempest-SnapshotDependencyTests-773078041 None] Created volume successfully. Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Deleting offline snapshot ddedd9eb-bef0-4867-b970-8c5be6dd6f9a of volume 149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] snapshot_file for this snap is: volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c966279d-c2ce-4074-a6ac-9be8da71cf63]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:07 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:27:07 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:08 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6692027-6226-47d3-a95c-24cd5dfac19c]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:08 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:27:08 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:08 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:08 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:27:08 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:08 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:08 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a Jul 21 19:27:08 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:09 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3.ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a" released by "_delete_snapshot" :: held 1.332s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" released by "delete_snapshot" :: held 1.353s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Created reservations ['dc556125-fd70-40e5-9e79-559fda024dca', '0cb53ed1-a81b-4d97-9cfd-7de82f928d8d', '9b14775a-2bdc-40b8-b6a2-3bc71a686ab7', '14fa8737-7827-4c18-954f-ee9ee7223189'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:27:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Delete snapshot completed successfully. Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-affaaba3-0ea7-4d74-9a6c-32150fc7f180 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-ddedd9eb-bef0-4867-b970-8c5be6dd6f9a-delete_snapshot" released by "delete_snapshot" :: held 1.476s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-149ed0e2-31b4-43d7-acc1-a66f07b55ec3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-149ed0e2-31b4-43d7-acc1-a66f07b55ec3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48432308-c006-449c-a1b0-6a1f2057f467]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:10 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:27:10 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:10 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:10 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3 Jul 21 19:27:10 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:10 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-149ed0e2-31b4-43d7-acc1-a66f07b55ec3" released by "delete_volume" :: held 0.635s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Created reservations ['41fee43b-b882-46f1-9eab-4c02f4d8ab49', '8b26b701-a188-4b4d-8a81-84f44ff78773', 'd8ab828d-250f-4c9b-b1e2-e306be476b2e', 'f128e347-f813-47e5-8ed7-dc842ed18ef7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:10 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:27:10 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:11 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:27:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Deleted volume successfully. Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9031cd47-f51e-4822-b39b-808f6a6b4bd3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-149ed0e2-31b4-43d7-acc1-a66f07b55ec3-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa73f94-4aec-4fe2-901b-5e3397c004b4]: (4, 'qcow2') {{(pid=89570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:11 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d Jul 21 19:27:11 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:11 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:11 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d Jul 21 19:27:11 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:11 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916/volume-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-quobyte-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d" released by "delete_volume" :: held 0.610s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Created reservations ['ede210e1-bbfa-474e-b841-28af2f544b0c', 'f68d54a2-42df-4c71-8e21-a929ea38cc8f', '483c04a8-28f9-4f1d-8377-94db51764202', 'e399e843-0536-44fd-aaca-5488b0519ade'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:11 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:27:11 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:12 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:27:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Deleted volume successfully. Jul 21 19:27:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4603a026-ed6a-4ba5-8ecf-78974a1848a3 tempest-SnapshotDependencyTests-773078041 None] Lock "cinder-08b7fabf-73bb-42bc-8f2d-09dc84c83b0d-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 19:27:21 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:27:22 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fa0fc6f-b9ee-47d2-bd78-f2f6012130c7'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 19:27:25 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916 Jul 21 19:27:25 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 19:27:25 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/297f8edcb43b73059a963157c477c916" returned: 0 in 0.223s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread count: 29 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 19:27:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d587cbdc-09a7-4650-808d-3b2de85e2e1e None None] thread info: [<_MainThread(MainThread, started 134454314471552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}